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ACHIEVING  BETTER  ACQUISITION  THROUGH  ADR 
AND  OTHER  BEST  PRACTICES  FOR  RESOLVING  BID 

PROTESTS 


ABSTRACT 


This  project  examines  bid  protest  prevention  and  resolution  strategies  to  shed 
light  on  ways  to  save  the  government  money  and  time.  Successful  resolutions  of  protests 
depends  on  a  number  of  factors,  including  government  and  private  sector  protest 
management  and  litigation  strategies;  Alternate  Dispute  Resolution  (ADR)  policies  of 
federal  agencies;  legal  and  regulatory  requirements;  and  remedies  available  to 
contractors.  Our  research  identifies  and  analyzes  best  ADR  practices  and  other  remedies 
and  preventions  for  resolving  bid  protests.  Areas  examined  include  processes  and 
remedies  utilized  by  selected  federal  agencies  and  obstacles  to  fomenting  improved 
cooperation  between  industry  and  government,  which  may  preclude  win-win  resolutions 
to  bid  protests.  Insights  regarding  the  validity  of  our  entering  hypotheses  about  ADR  are 
obtained  from  a  survey  of  acquisition  and  legal  professionals  regarding  their  perceptions, 
opinions,  and  recommendations  on  bid  protest  practices  and  the  use  of  ADR  procedures. 
Our  objectives  are  to  identify  ADR  and  other  process  improvement  recommendations 
that  are  crucial  to  effective  contracting  and  support  the  government’s  efforts  to  improve 
adjudicative  forums  for  resolution  of  contract  disputes  and  bid  protests.  Our  research 
suggests  that  agencies  can  mitigate  protest  expenses  and  interruptions  by  managing  the 
protest  process  in  a  systematic,  business-like  way.  At  the  present  time,  agencies  rarefy 
use  most  procedural  tools  that  are  required  or  authorized  under  federal  laws  and 
regulations  to  reduce  time  delays  and  costs  from  bid  protests.  Among  other  things,  we 
recommend  energetic  agency  approaches  to  preventing  disputes  (e.g.,  quality 
debriefings),  and  dealing  with  disputes  (e.g.,  formal  cost-benefit  analysis  of  agency 
defense  strategies,  strong  defense  of  agency  actions,  and  full  use  of  ADR  methods).  We 
also  recommend  ADR  as  the  default  method  for  settling  bid  protests. 
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I.  INTRODUCTION 


A.  PURPOSE 

The  Office  of  Assistant  Secretary  for  Acquisition,  U.S.  Department  of  the  Air 
Force,  requested  the  Naval  Postgraduate  School  to  study  strategies  to  minimize  time 
delays  and  costs  borne  by  defense  acquisition  programs  as  a  result  of  bid  protests.  Bid 
protests  are  defined  by  the  Competition  in  Contracting  Act  of  1984  (CICA)  as: 

Written  objection  by  an  interested  party  to  any  of  the  following:  a 
solicitation  by  an  agency  for  offers  for  a  contract  for  the  procurement  of 
property  or  services,  the  cancellation  of  the  solicitation,  an  award  or 
proposed  award  of  the  contract,  and  the  termination  of  an  award  of  the 
contract  if  the  written  objection  contains  an  allegation  that  the  termination 
is  based  in  part,  on  the  improprieties  concerning  the  award  of  the 
contract.  1 

The  successful  resolutions  of  protests  depends  on  a  number  of  factors,  including 
government  and  private  sector  litigation  strategies,  the  Alternative  Dispute  Resolution 
(ADR)  policies  of  federal  agencies,  legal  and  regulatory  requirements,  and  remedies 
available  to  contractors.  In  the  report  that  follows,  we  conclude  that  better  ADR 
practices  and  other  prevention  and  resolution  strategies  need  to  be  identified  and 
implemented.  The  purpose  of  this  project  is  to  evaluate  bid  protest  prevention  and 
resolutions  strategies  and  identify  best  practices  in  order  to  save  the  government  money 
and  time. 

B,  BACKGROUND 

In  any  bid  protest  system,  there  are  four  principal  parties:  the  disappointed  offeror 
denied  a  contract  award  or  potential  offeror  excluded  from  competition,  the  acquiring 
agency,  the  public  at  large  and  their  elected  representatives,  and  possibly,  an  intervening 
offeror  or  successful  awardee.  Each  principal  has  a  distinct  interest  in  the  resolution  of 
the  protest.  The  unsuccessful  offerors  seek  a  forum  to  air  their  complaints  and  to  learn  as 
much  information  as  possible  about  denial  or  exclusion,  and  ultimately  obtain  some  type 

^  United  States  Code,  31  §  3551(1). 


1 


of  meaningful  relief.  The  aequiring  agency  seeks  a  resolution  to  the  protest  in  a  manner 
that  does  not  hinder  the  effectiveness  or  efficiency  of  the  acquisition  process.  The  public 
seeks  a  resolution  that  promotes  the  integrity  and  effectiveness  of  the  acquisition  system 
while  holding  government  officials  accountable  for  their  actions.  The  intervening 
offeror  seeks  resolution  that  supports  the  original  award  or  favorable  terms  for  award. 

There  are  a  number  of  fora  where  a  protestor  can  seek  relief.  Protests  can  be 
filed  with  the  procuring  agency ,3  with  the  Government  Accountability  Office  (GAO)^,  or 
the  U.S.  Court  of  Federal  Claims. ^  The  Comptroller  General,  head  of  the  GAO,  is 
mandated  by  CICA  to  provide  “for  the  inexpensive  and  expeditious  resolution  of 
protests.”^  In  1995,  President  William  J.  Clinton  signed  Executive  Order  No.  12979 
mandating  that  agencies  “to  the  maximum  extent  practicable,  provide  for  inexpensive, 
informal,  procedurally  simple,  and  expeditious  resolution  of  protests,  including,  where 
appropriate  and  as  permitted  by  law,  the  use  of  alternative  resolution  techniques.”  In  that 
Order,  President  Clinton  stated  that  these  measures  were  intended  “to  ensure  effective 
and  efficient  expenditure  of  public  funds  and  fair  and  expeditious  resolution  of  protests  to 
the  award  of  Federal  procurement  contracts.”  The  Federal  Acquisition  Regulation  also 
incorporates  the  tenets  of  CICA  and  E.O.  12979  in  Subpart  33.1,  Protests. 
Implementation  of  ADR  practices  is  a  major  means  by  which  the  GAO  and  federal 
agencies  can  put  into  practice  these  legal  obligations. 

During  Fiscal  Year  2008,  1,652  bid  protests  were  filed  with  the  GAO.  GAO 
issued  formal  decisions  in  291  cases,  sustaining  60  protests  (more  detailed  statistics  are 
provided  in  Chapter  II).  In  the  same  year,  GAO  utilized  self-described  ADR  practices  to 
resolve  78  cases,  citing  a  78%  success  rate.  Success  in  these  instances  is  defined  as 
resolution  absent  a  formal  GAO  decision.  ^  In  general,  the  GAO  utilizes  two  types  of 

3  Daniel  I.  Gordon,  “Constructing  a  Bid  Protest  Process:  Choices  Every  Procurement  Challenge 
System  Must  Make,”  Public  Contract  Law  Journal  3  (2006):  4. 

3  Code  of  Federal  Regulations,  48  §  33.103(c). 

^  United  States  Code,  31  §  3551  et.  seq. 

3  United  States  Code,  28  §  1491(b). 

3  United  States  Code,  31  §  3554  (a)(1). 

^  U.S.  Government  Accountability  Office,  09-251R. 
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ADR,  negotiation  assistance  at  the  beginning  and  outcome  prediction  at  the  end  of 
litigation  (where  the  majority  of  costs  and  delays  have  already  been  incurred).^  The  only 
substantial  difference  between  outcome  prediction  and  a  formal  decision  is  the  issuance 
of  a  written  decision  by  GAO.  In  terms  of  time,  effort,  and  cost,  the  processes  are  nearly 
identical. 

C.  RESEARCH  OBJECTIVE 

The  objective  of  this  project  is  to  specifically  identify,  analyze,  and  develop  better 
ADR  practices  and  other  prevention  and  resolution  strategies  to  control  protest  costs  and 
delays.  Such  practices  and  strategies  must,  at  a  minimum,  provide  an  interested  party  the 
opportunity  for  meaningful  relief,  promote  the  efficiency  and  effectiveness  of  the 
acquisition  system,  and  preserve  the  public’s  trust  in  the  fairness  of  the  acquisition 
process. 

D,  RESEARCH  QUESTIONS 

Since  this  project  will  consist  of  the  identification  and  analysis  of  best  ADR 
practices  for  resolving  bid  protests,  the  main  focus  will  revolve  around  the  primary 
research  question  of:  What  ADR  strategies,  remedies,  or  practices  exist,  that,  if  adopted 
by  the  Department  of  Defense  (DoD),  would  lessen  the  systemic  impact  of  bid  protests 
on  the  acquisition  process  in  terms  of  delays  and  costs? 

Specific  areas  addressed  consist  of  processes  and  remedies  utilized  by  selected 
federal  agencies  and  the  barriers  to  more  effective  cooperation  between  industry  and 
government  that  may  prohibit  give-and-take  compromises  resulting  in  acceptable  bid 
protests  resolutions.  Our  analysis  will  also  answer  the  following  research  questions: 

•  What  strategies  or  practices  are  currently  being  used  to  minimize  the 
impact  of  bid  protest  delays  and  costs  on  the  acquisition  process  while 
maintaining  integrity,  economy,  and  efficiency? 

•  What  current  processes  or  regulations  preclude  effective  avoidance  or 
resolution  of  bid  protests  in  a  manner  that  minimizes  adverse  impacts  on 
the  acquisition  system? 


^  U.S.  Government  Accountability  Office,  09-4715P. 
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•  What  are  the  obstacles  that  impede  effective  cooperation  in  resolving  bid 
protests? 

This  research  will  provide  decision  makers  with  a  usable  analysis  of  current  “best 
practice”  examples  along  with  recommendations. 

E,  METHODOLOGY 

This  project  is  based  on  a  general  literature  review,  including  federal  agency 
reports  from  the  General  Accounting  Office,  Department  of  Defense  and  Service 
component  regulations,  reports,  journal  articles,  written  texts,  web  searches,  and  surveys 
conducted  with  General  Counsel  and  Acquisition  leadership  personnel  within  the  military 
services  and  select  federal/DoD  agencies.  The  research  methodologies  for  this  project 
include  the  following; 

•  A  survey  of  Legal  and  Acquisition  leadership  within  the  military  services 
and  select  federal/DoD  agencies. 

•  A  review  of  academic  literature,  government  reports,  government 
regulations  and  statutes,  and  other  professional  papers. 

•  An  analysis  and  comparison  of  bid  protest  practices  within  the  Army 
Materiel  Command  (AMC),  the  GAO,  and  the  Federal  Aviation 
Administration  (FAA). 

F.  THESIS  ORGANIZATION 

This  project  is  organized  into  seven  chapters.  Chapter  II  provides  an  overview  of 
the  current  bid  protest  process  along  with  background  information.  Chapter  III  provides 
an  analysis  of  FAA  and  AMC  bid  protest  procedures  compared  with  those  of  the  GAO. 
Chapter  IV  describes  our  survey  goals,  design,  methodology,  and  scoring.  Chapter  V 
discusses  our  survey  results  and  provides  an  in  depth  analysis  of  the  results.  Chapter  VI 
is  our  conclusion,  summarizing  the  results  of  our  project.  Chapter  VII  details  our 
recommendations  and  discusses  areas  for  further  research. 
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II.  BACKGROUND 


A.  INTRODUCTION 

In  a  2006  paper  entitled  “Construeting  a  Bid  Protest  Proeess:  Choiees  Every 
Proeurement  Challenge  System  Must  Make,”  eurrent  Administrator  for  Federal 
Proeurement  Policy  and  then-GAO  Associate  General  Counsel  Daniel  Gordon,  described 
a  protest  as  an  action  that  is  “always  between  the  agency  and  a  vendor  that  wants  but 
does  not  have  a  contract.”^  A  protester  is  typically  a  party  aggrieved  by  the  actions  of  a 
government  agency  that  resulted  or  could  result  in  the  award  of  a  contract  to  an  offeror 
viewed  by  the  protester  as  non-deserving  for  various  reasons.  Both  the  Competition  and 
Contracting  Act  and  the  Federal  Acquisition  Regulation  Part  33  permits  protests  to  be 
resolved  through  judicial  or  administrative  litigation,  but  informal  procedures  are 
encouraged.  One  of  the  key  requirements  to  prevail  in  a  bid  protest  is  a  showing  that 
the  protester  has  been  prejudiced  by  improper  agency  activities.  The  mere  presence  of 
mistake  or  illegal  action  does  not  necessarily  imply  a  protest  has  merit  unless  the 
protestor  can  show  they  were  in  some  way  prejudiced  by  the  agency’s  mistake  or  illegal 
activity.  In  other  words,  the  mistake  or  illegality  must  affect  acquisition  planning  or 
award  decision.  A  protester  who  prevails  is  entitled  to  a  remedy,  usually  in  the  form  of 
corrections  in  the  bidding  process  or  monetary  reimbursement  of  bid  and  proposal  costs 
and/or  legal  consultation  fees. 

The  Comptroller  General  of  the  Government  Accountability  Office  is  mandated 
by  CICA  to  provide  “for  the  inexpensive  and  expeditious  resolution  of  protests.”^'  With 
this  legal  mandate  comes  a  necessary  duty  to  serve  the  public  interest.  As  noted  by  the 
GAO’s  General  Counsel,  Mr.  Gary  Kepplinger,  the  GAO  seeks: 

...to  balance  the  competing  interests  and  goals  of  the  procurement 

process... the  presence  of  an  independent  forum  for  disappointed  bidders 

9  Gordon,  “Constructing  a  Bid  Protest  Process:  Choices  Every  Procurement  Challenge  System  Must 
Make,”  2. 

10  Federal  Acquisition  Regulation,  Subpart  33.1. 

11  United  States  Code,  31  §  3554  (a)(1). 
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enhances  the  accountability  of  procurement  officials  and  agencies,  opens  a 
window  of  transparency  into  how  the  procurement  system  operates,  and 
protects  the  integrity  and  legitimacy  of  a  competitive  and  robust  federal 
procurement  process.'^ 


At  the  center  of  any  bid  protest  is  a  certain  inherent  conflict  between  the  needs  of 
the  agency  concerned  and  the  rights  of  the  disappointed  bidder.  An  efficient  bid  protest 
process  must  ensure  protests  are  handled  expeditiously,  thereby  minimizing  the 
disruption  to  the  acquisition  process.  An  effective  system  must  ensure  disappointed 
bidders  are  given  a  forum  to  air  their  grievances  and  agency  officials  are  held  accountable 
for  their  actions.  13  Figure  1  illustrates  this  concept. 


Agency 


Disappointed 

Bidder 


Winning 

Bidder 


Citizenry  and  Congress 


Figure  1.  Competing  Interests  in  a  Protest  System 


12  Gary  Kepplinger,  “Commentary:  GAO's  Bid  Protest  Role,”  Federal  Times  (January  19,  2009):  1. 

13  Margaret  M.  Worthington  and  Louis  P.  Goldsman,  Contracting  with  the  Federal  Government  (New 
York:  John  Wiley,  1998),  472. 
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B,  IMPACT  ON  ACQUISITION  PROCESS 


The  number  of  protests  filed  has  inereased  by  37%  between  FY  2001  and  FY 
2008/"^  Bid  protests  continue  to  have  a  systemic  impact  on  the  acquisition  system. 
Figure  2,  illustrates  the  trend  in  protests  at  the  GAO  over  the  last  twenty  years. 


Figure  2.  Number  of  Protests  Filed  at  the  GAO  since  1989^^ 


Though  the  number  of  protests  has  declined  in  historical  terms,  it  is  worth  noting 
the  increase  in  protests  starting  in  FY  2001 .  The  number  of  protests  filed  at  the  GAO  has 
increased  by  37%  between  FY  2001  and  FY  2008.^^  Figure  3  contains  detailed  GAO  bid 
protest  statistics  for  FY’s  2001  through  2008.  Data  from  the  Federal  Procurement  Data 
System  shows  that  over  the  same  period  the  number  of  federal  contract  actions  fell  by 
26.79%  from  11,410,869  to  8,354,648,  while  total  federal  procurement  dollars  jumped  by 
128.69%  from  $234,879,065,000  to  $537,155,101,194. 


Moshe  Schwartz  and  Kate  M.  Manuef  United  States.  GAO  Bid  Protests:  Trends,  Analysis,  and 
Options  for  Congress.  Cong.  Doc.  CRS  R40227.  2009,  2. 

U.S.  Government  Accountability  Office,  B-401197,  7. 

Moshe  Schwartz  and  Kate  M.  Manuel.  United  States.  GAO  Bid  Protests:  Trends,  Analysis,  and 
Options  for  Congress.  Cong.  Doc.  CRS  R40227.  2009,  2. 
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FY 

2001 

2002 

2003 

2004 

2005 

2006 

2007 

2008 

Protests  Filed 

1,146 

1,204 

1,352 

1,485 

1,356 

1,327 

1,411 

1,652 

Protests  Closed 

1098 

1133 

1244 

1405 

1341 

1274 

1393 

1581 

Closed  Protests 

Resolved  on  their 

Merit 

311 

256 

290 

365 

306 

249 

335 

291 

Sustained  in 

Whole  or  Part 

66(21%) 

41(16%) 

50(17%) 

75(21%) 

71(23%) 

72(29%) 

91(27%) 

60(21%) 

Effectiveness  Rate 

33% 

33% 

33% 

34% 

37% 

39% 

38% 

42% 

Cases  Resolved 
Through  ADR 

150(84%) 

145(84%) 

120(92%) 

123(91%) 

103(91%) 

91(96%) 

62(85%) 

78(78%) 

GAO  Hearings  for 
Fully  Developed 

Decisions 

63(12%) 

23(5%) 

74(13%) 

56(9%) 

41(8%) 

51(11%) 

41(8%) 

32(6%) 

d 

Figure  3.  GAO  Bid  Protest  Statistics  FY2001-FY2008i^ 


The  number  of  bid  protests  filed  with  the  United  States  Court  of  Federal  Claims  is 


presented  in  Figure  4. 


FY 

2000 

2001 

2002 

2003 

2004 

2005 

2006 

2007 

Number  of  Cases 

Involving  Bid  Protests 

54 

57 

39 

55 

69 

61 

73 

70 

Percentage  of  Cases 
Involving  Bid  Protests 

6.8% 

7.3% 

2.6% 

1.8% 

2.9% 

3.6% 

6.8% 

6.4% 

Figure  4.  Bid  Protests  at  the  United  States  Court  of  Federal  Claims  FY2000-FY2007i^ 


Bid  protests  continue  to  have  a  systemic  impact  on  the  acquisition  system.  No 
federal  agency  is  more  acutely  aware  of  this  trend  than  the  Department  of  Defense.  As 
noted  in  2007,  by  then  Undersecretary  of  Defense  for  Acquisition,  Technology,  and 
Logistics  (USD  AT&L),  the  Honorable  John  J.  Young; 

Protests  are  extremely  detrimental  to  the  warfighter  and  the  taxpayer, 

[they]  consume  vast  amounts  of  the  time  of  acquisition,  legal,  and 
requirements  team  members;  delay  program  initiation  and  the  delivery  of 


Michael  J.  Schaengold,  T.  Michael  Guiffre,  Elizabeth  M.  Gill,  “Choice  of  Forum  for  Federal 
Government  Contract  Bid  Protests,”  18  Federal  Bar  Circuit  Journal  (2009):  255. 

Schanegold,  Guiffre,  and  Gill,  “Choice  of  Forum  for  Federal  Government  Contract  Bid  Protests,” 

255. 
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capability;  strain  relations  with  our  industry  partners  and  stakeholders;  and 
ereate  mispereeptions  among  American  citizens/^ 

In  general,  all  protests  ean  potentially  involve  a  delay  in  eontract  award  or 
performanee  as  well  as  internal  and  out-of-poeket  costs.  The  mueh-publieized  ease  of  the 
U.S.  Air  Foree’s  KC-X  Air  Refueling  Tanker  clearly  demonstrates  the  impaet  protests 
can  have  on  the  aequisition  system.  In  January  2007,  the  Air  Force  issued  a  Request  for 
Proposals  (RFP).^°  On  February  29,  2008,  the  Air  Force  seleeted  Northrop  Grumman  for 
eontract  award.  On  March  11,  2008,  Boeing  filed  a  protest  with  the  GAO,  whieh  the 
GAO  sustained  in  a  written  deeision  on  June  18,  2008.  During  the  lengthy  protest 
litigation,  the  Air  Foree  paid  the  salaries  of  its  nineteen-lawyer  defense  team,  and  the 
GAO  deeision  reeommended  that  the  Air  Foree  pay  the  fees  of  fifteen  attorneys  of  record 
representing  Boeing.  By  Oetober  of  2009,  the  Air  Force  once  again  issued  a  “new”  draft 
RFP  for  the  KC-X  tanker.  To  date,  no  award  has  been  made.  Despite  the  merit  the 
GAO  found  in  Boeing’s  protest  (i.e.  lack  of  discipline  in  the  USAF  source  seleetion), 
there  was  a  countervailing  deleterious  impaet  on  the  aequisition  proeess.  For  a  period  of 
over  two  years,  the  Air  Force  has  been  unable  to  award  a  contract  for  an  air  refueling 
tanker.  In  fact,  during  2008,  bid  protests  delayed  three  major  defense  acquisition 
programs,  valued  at  over  $70  million.^^  Such  situations  clearly  underscore  the  point  made 
by  Underseeretary  Young. 

Although  the  GAO  has  consistently  resolved  all  protests  within  their  required 
statutory  time  frame  of  100  days,  the  systemie  impact  of  protests  still  remain.  Both 
industry  and  government  should  welcome  the  implementation  of  a  policy  that  could 
reduce  this  impaet.  Alternative  Dispute  Resolution  is  one  such  policy  that  if  used 
effectively,  has  sueh  potential.  Additionally,  ADR  has  the  potential  to  preserve  the 

RDML  Sean  Crean,  Deputy  Assistant  Secretary  of  the  Navy,  Acquisition  and  Logistics 
Management, “Improving  Communication  during  Competitive  Source  Selections,”  Letter  to  Heads  of 
Contracting  Activities,  January  8,  2008,  3. 

U.S.  Government  Accountability  Office,  B-311344,  5. 

21  U.S.  Government  Accountability  Office,  08-991T,  3. 

22  U.S.  Air  Force  FA8625-10-R-6600,  1. 

22  Schwartz,  GAO  Bid  Protests:  Trends,  Analysis,  and  Options  for  Congress,  10. 

24  Schwartz,  GAO  Bid  Protests:  Trends,  Analysis,  and  Options  for  Congress,  9. 
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delicate  balance  between  the  competing  interests  of  the  bid  protest  process  and  to 
empower  military  and  civilian  agencies  to  reduce  protests  costs  and  delays.  In  order  to 
understand  this  fully,  one  must  have  a  basic  understanding  of  how  and  when  bid  protests 
arise,  the  path  they  follow  on  their  way  to  resolution,  the  defensive  strategies  that  can  be 
used  to  prevent  protests  and  control  their  resolution  path,  and  the  cost  and  benefit  trade¬ 
offs  agencies  face  from  various  protest  defense  strategies. 

C.  AGENCY  MANAGEMENT  OF  THE  PROTEST  PROCESS  TO 

MITIGATE  TIME  DELAYS  AND  COSTS 

1.  USE  OF  STAY  OVERIDES  TO  MINIMIZE  TIME  DELAYS 

As  FAR  Subpart  33.1  indicates,  a  protest  timely  filed  at  the  GAO  or  agency 
results  in  a  mandatory  stay  of  the  procurement  or  proposed  procurement.  Agencies  can 
also  impose  discretionary  stays.  The  government  can  override  a  mandatory  stay  only 
based  on  “urgent  and  compelling  circumstances  which  significantly  affect  the  interest  of 
the  United  States  [that]  will  not  permit  waiting  for  the  GAO’s  decision”  or  based  on 
“best  interests  of  the  United  States. ”^5  In  general,  a  protest  may  occur  at  any  one  of  five 
stages  in  the  acquisition  process. 

•  Prior  to  solicitation  (e.g..  Requests  for  Information,  FAR  Part  5  Synopsis). 

•  During  the  solicitation  (e.g..  Requests  for  Proposals,  Invitation  for  Bids), 
Requests  for  Quotation). 

•  During  the  evaluation  (at  creation  of  the  competitive  range) 

•  Post  Award 

•  After  agency-level  protest 

At  the  agency  level,  a  stay  override  is  available  on  both  grounds  during  the  first 
four  procurement  stages.  If  the  agency-level  resolution  is  not  satisfactory  to  the  protester 
and  a  GAO  protests  is  filed,  a  stay  override  may  be  available  at  that  time  as  well.  At  the 
GAO,  mandatory  stays  at  two  first  pre-award  stages  can  be  overridden  only  for  urgent 
and  compelling  circumstances  if  the  award  is  likely  within  thirty  days.  During  the  second 
and  third  stages,  the  30-day  requirement  is  not  applicable  and  stays  can  be  overridden  for 
best  interests.  If  the  protester  is  an  incumbent  denied  new  award,  the  agency  may  be 

Federal  Aequisition  Regulation,  Part  33.104. 
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required  to  issue  a  bridge  eontraet  in  lieu  of  override.  A  protester  may  go  to  the  Court  of 
Federal  Claims  to  ehallenge  the  override  of  stay  at  the  GAO  or  ageney  level.  However, 
sueeessful  stay  overrides  are  also  risky.  If  an  ageney  ultimately  loses  the  protest  after 
obtaining  a  stay  override,  and  performanee  has  been  substantially  eompleted,  the 
ageney ’s  total  eontraet  eost  would  inerease  beeause  the  GAO  would  likely  reeommend 
the  ageney  to  pay  the  protester  its  legal  fees  as  well  as  its  bid  and  proposal  eosts.  The 
flow  eharts  eontained  in  Figures  5,  6,  and  7  depiet  eaeh  of  these  instanees  for  all  protests 
instanees  at  the  GAO,  as  well  as  the  deeision  points.  Protests  filed  at  the  Court  of  Federal 
Claims  do  not  trigger  automatie  stays.  The  Court  may  impose  a  stay  through  a 
Temporary  Restraining  Order  or  a  Preliminary  Injunetion,  or  the  government  may  agree 
to  a  voluntary  stay  in  lieu  of  injunetion.  They  may  avoid  a  stay  by  arguing  that  the 
protester  is  unlikely  to  sueeeed  on  the  merits,  the  harm  to  the  ageney  outweighs  the  harm 
to  the  protester,  the  publie  interest  is  served  by  allowing  the  proeurement  to  eontinue,  and 
the  protester  will  not  suffer  irreparable  injury  without  remedy. 
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Figure  5.  GAO  Protest  Process  (Planning  /  Request  for  Information)^^ 


Max  V.  Kidalov  and  Diana  Angelis,  Naval  Postgraduate  School,  Work  Paper,  “GAO  Protest 
Process  Flow  Charts  and  Guide  to  Managing  Costs  and  Time  Delays  in  Bid  Protests”  (2009). 
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Figure  6.  GAO  Protests  Proeess  (Request  for  Proposal/Invitation  for  Bid)^^ 


Max  V.  Kidalov  and  Diana  Angelis,  “GAO  Protest  Process  Flow  Charts  and  Guide  to  Managing 
Costs  and  Time  Delays  in  Bid  Protests”. 
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Figure  7.  GAO  Protest  Proeess  (Post  Award)^^ 

2.  USE  OF  DEFENSIVE  STRATEGIES  TO  MINIMZE  TIME 
DELAYS  AND  COSTS 

In  addition  to  stay  overrides,  ageneies  have  five  (5)  choices  of  defensive  strategies 
that  may  reduce  or  enlarge  delays  and  costs  from  bid  protests  depending  on  the  strategy 
chosen.  There  are  multiple  possible  strategies  and  resolutions  to  a  protest: 

•  The  GAO  dismisses  the  protest  as  frivolous,  meritless,  or  outside  of  its 
jurisdiction  (including  one  that  is  untimely  or  where  prejudice  is  lacking). 

•  The  agency  takes  early  voluntary  corrective  action  and  the  protest  is 
withdrawn. 

•  ADR  (as  defined  in  the  U.S.  Department  of  Justice  Electronic  Guide  to 
Federal  Procurement  ADR  and  cited  in  Appendix  A)  is  utilized  to  resolve 
the  protest  and  the  protest  is  withdrawn. 


Max  V.  Kidalov  and  Diana  Angelis,  “GAO  Protest  Process  Flow  Charts  and  Guide  to  Managing 
Costs  and  Time  Delays  in  Bid  Protests”. 
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•  The  agency  opts  for  a  formal  litigation  before  the  GAO  by  filing  an 
agency  report.  The  GAO  may  issue  a  written  opinion  or  conduct  one  of 
two  special  kinds  of  GAO  ADR  (negotiation  assistance  or  outcome 
prediction). 

•  The  agency  opts  for  expedited  litigation  by  seeking  an  express  option. 

The  first  three  options  enable  agencies  to  achieve  full  resolution  at  less  than  30 
days  and  avoid  paying  protester  legal  fees.  Litigation  under  the  fourth  strategy  can  last 
one -hundred  (100)  days,  and  under  the  fifth  strategy,  sixty-five  (65)  days.  The  last  two 
strategies  allow  the  agency  to  secure  GAO  validation  of  agency’s  procurement  decisions 
in  the  form  of  a  favorable  GAO  opinion,  but  at  the  risk  of  having  to  pay  protester  its  legal 
fees  in  the  event  of  loss.  Upon  receipt  of  a  protest,  the  agency  must  determine  how  to 
defend  against  the  protest.  If  the  agency  believes  that  the  protest  is  indeed  frivolous, 
meritless,  or  jurisdiction,  then  it  can  seek  summary  dismissal  from  the  GAO.  Barring 
such  a  dismissal  from  GAO,  the  agency  must  then  prepare  to  defend  its  procurement 
action  before  the  GAO  (possibly  utilizing  the  express  option),  take  voluntary  corrective 
action,  or  utilize  ADR. 

Figure  8  depicts  this  process,  as  well  as  the  decision  points. 
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Figure  8.  Protest  Response29 


3.  USE  OF  ADR  TO  MINIMIZE  TIME  DELAYS  AND  COSTS 

A  shown  in  Figure  8,  there  are  essentially  five  decision  points  where  an  agency 
can  infiuence  the  process.  As  discussed  earlier,  an  agency  may  seek  dismissal  from  GAO 
on  grounds  that  the  protest  is  either  meritless,  frivolous,  or  lacks  jurisdiction,  an  agency 
may  take  voluntary  corrective  action,  or  an  agency  may  pursue  ADR.  Should  an  agency 
attempt  to  litigate  a  protest  and  lose,  the  agency  may  be  responsible  for  paying  “the 
successful  protestor”  the  cost  for  “fding  and  pursing  the  protest,  including  attorney’s  fees 
and  counsel  and  expert  witness  fees. ”30  While  the  exact  costs  a  protestor  may  incur  in 
filing  a  protest  varies,  in  the  past  GAO  has  recommended  agencies  pay  successful 


39  Kidalov  and  Angelis,  “GAO  Protest  Process  Flow  Chart.” 
30  4C.F.R.  §21.8(d)(l). 
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protestors  payment  in  excess  of  $300,000.31  government  strategy  or  practice  short  of 
adjudication  may  result  in  the  government  not  having  to  reimburse  a  successful  protestor 
for  the  costs  associated  with  filing  the  protests.  As  a  result,  in  addition  to  time,  ADR  has 
the  potential  to  save  the  government  money. 

ADR  is  far  from  a  new  concept.  In  1995,  President  Clinton  issued  Executive 
Order  No.  12979  mandating  that  agencies  use  “to  the  maximum  extent  practicable... the 
use  of  alternative  dispute  resolution  techniques.”  Within  GAO,  there  are  two  “ADR 
options”  available,  negotiation  assistance  and  outcome  prediction.  Outcome  prediction 

-5-5 

is  the  most  common  form  of  ADR  employed  by  GAO.  However,  since  negotiation 
assistance  can  occur  prior  to  submission  of  the  agency  report,  it  offers  the  greatest 
potential  to  reduce  the  delay  a  protest  has  on  a  particular  acquisition.  Conversely, 
outcome  prediction  takes  place  only  after  all  issues  have  been  raised  and  an  evidentiary 
hearing  has  taken  place,^"^  at  which  point  the  GAO  attorney  will  advise  the  parties  of  the 

-5C 

“likely  outcome  of  the  case.” 

Thus,  the  substantial  difference  between  outcome  prediction  and  the  formal 
adjudication  of  a  protest  is  merely  the  absence  of  written  decision  by  GAO  in  the  former. 
In  terms  of  minimizing  delays  to  the  acquisition  process,  it  does  not  seem  that  outcome 
prediction  is  very  a  useful  mechanism.  Outcome  prediction  serves  to  minimize  the 
reputational  damage  to  an  agency  or  its  official  responsible  for  the  procurement  at  issue, 
but  does  not  prevent  the  same  problem  that  led  to  the  protest  from  occurring  in  the  future. 

D.  BENEFITS  OF  ADR  IN  RESOLVING  PROTESTS 

As  noted  previously,  protests  usually  involve  a  delay  in  either  contract  award  or 
performance  which  can  adversely  impact  the  mission  of  the  agency  concerned.  A  goal  of 
ADR  should  be  to  minimize  this  delay.  Best  ADR  practices  need  to  be  identified  and 


31  U.S.  Government  Aceountability  Office,  B-400058.4 

32  U.S.  Government  Accountability  Office,  09-471SP,  27. 

33  William  J.  Spriggs  and  Max  V.  Kidalov,  “No  Way  to  Protest,”  Legal  Times  (March  17,  2003):  2. 

34  Spriggs  and  Kidalov,  “No  Way  to  Protest,”  2. 

33  U.S.  Government  Accountability  Office,  09-471SP,  27. 
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implemented  by  federal  ageneies.  One  need  not  look  further  than  the  federal  government 
itself  to  find  numerous  examples  of  sueeessful  ADR  programs. 

Statutorily  exempt  from  the  federal  aequisition  system  under  the  1996 
Department  of  Transportation  (DOT)  Appropriations  Act^^,  the  Federal  Aviation 
Administration  has  developed  its  own  set  of  proeurement  polieies  that  include  the  use  of 
ADR.  Similarly,  in  an  effort  to  reduce  the  impact  of  protests,  the  United  States  Army 
Materiel  Command,  implemented  a  comprehensive  ADR  program  of  its  own  including 
agency  level  protest  under  the  agency  level  protest  authority.  A  comparison  of  the 
FAA’s  and  AMC’s  practices  compared  to  those  of  the  GAO  process  is  presented  in 
Chapter  V. 

In  order  to  gain  insight  into  these  practices,  their  use  within  various  agencies,  and 
to  discover  potential  areas  for  improvement  a  comprehensive  survey  of  federal 
government  acquisition  and  legal  professionals  was  conducted.  The  methodology 
employed  and  the  corresponding  results  and  analysis  are  reported  in  Chapters  III  and  IV, 
respectively. 


36  Public  Law  104-50. 
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III.  SURVEY  METHODOLOGY 


A,  SURVEY  GOALS 

In  order  to  identify  best  practices,  input  was  sought  from  top  level  acquisition  and 
legal  leaders  and  experts  within  the  military  departments  and  all  major  federal  buying 
agencies.  Fifty-one  individuals  were  asked  to  complete  an  online  survey.  A  copy  of  the 
survey  protocol  is  contained  in  Appendix  B.  The  aim  of  the  survey  was  to  document  the 
perceptions,  opinions,  and  recommendations  of  those  individuals  involved  in  the 
acquisition  process.  With  this  information,  it  is  then  possible  to  identify  trends,  best 
practices,  and  deficient  areas  that  need  improvement.  Through  this  process,  we  were  able 
to  develop  recommendations  that  if  adopted,  could  possibly  reduce  the  systemic  impact 
of  bid  protests  on  the  acquisition  cycle  by  empowering  agencies  to  better  manage  protest 
costs  and  time  disruptions. 

B,  SURVEY  DESIGN 

The  survey  focuses  on  three  main  research  questions: 

•  What  strategies  or  practices  are  used  by  agencies  to  prevent/minimize  the 
impact  of  bid  protests? 

•  To  what  extent  are  alternative  dispute  resolution  procedures  utilized  as  a 
means  to  prevent/minimize  the  impact  of  bid  protests? 

•  What  aspects  of  statute,  policy,  or  regulation  preclude  the  effective 
resolution  of  protests  in  a  manner  that  minimizes  their  systemic  impact? 

Within  each  of  these  three  areas  of  focus,  respondents  were  asked  to  rate  their 
agency’s  use  of  specific  strategies,  practices,  and  policies  pertaining  to  bid  protests  and 
ADR.  Respondents  were  also  asked  to  identify  what  they  believe  to  be  the  relevant 
factors  that  either  constrain  or  encourage  an  aggrieved  offeror  to  protest.  Lastly, 
respondents  were  asked  to  describe  possible  improvements  to  law,  policy,  or  regulation, 
that  would  increase  the  effectiveness  of  the  protest  system,  while  at  the  same  time,  would 
ensure  transparency,  integrity,  compliance,  economy  and  efficiency. 
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c. 


SURVEY  SCORING 


Respondents  were  asked  to  rate  speeific  aspects  of  policy,  strategy,  and  procedure 
on  a  four-point  version  of  Likert’s  eponymous  rating  scale  (shown  below). 

•  4 — Always  or  With  Great  Frequency 

•  3 — With  Moderate  Frequency 

•  2 — In  Exceptional  Cases  or  With  Rare  Frequency 

•  1 — ^Never 

Respondents  were  also  given  the  option  of  choosing,  “Don’t  Know  or  Information 
Unavailable.”  If  a  respondent  chose  this  option,  the  response  was  not  included  in  the 
scoring.  With  respect  to  the  relevant  factors,  that  constrain  our  encourage  protests  and 
possible  improvements  to  law,  policy,  or  regulation,  respondents  were  given  the 
opportunity  to  post  comments  in  a  free  form  text  box. 

D.  SURVEY  SUBJECTS 

Major  federal  procurement  agencies  were  asked  to  participate  in  the  survey.  A 
complete  list  of  agencies  solicited  is  contained  in  Appendix  C.  Agency  points  of  contact 
were  obtained  from  publicly  available  information  posted  on  agency  websites  or  from 
personal  contacts  of  this  project’s  lead  advisor.  Each  point  of  contact  was  sent  an  e-mail 
with  a  request  to  participate  in  the  survey  and  a  link  to  the  SurveyMonkey  website  where 
the  on-line  survey  was  posted.  Point  of  contacts  may  have  assigned  additional 
respondents  within  their  agency.  Respondents  were  asked  to  identify  both  their  agency 
and  their  professional  background  (legal  or  acquisition)  in  the  survey.  Respondents’ 
names  and  actual  position  within  their  agency  were  not  collected  and  therefore  remain 
anonymous. 

E,  SURVEY  LIMITATIONS 

It  should  be  noted  that  this  particular  survey  was  not  intended  as  a  “hard  data” 

appraisal  of  agency  practices.  The  results  of  the  survey  have  not  been  measured  against  a 

specific  set  of  objective  criteria  (e.g.,  number  of  protests  per  agency).  Rather,  the  survey 

was  intended  as  a  means  to  identify  perceptions,  opinions,  and  trends  from  those 

individuals  who  posses  significant  professional  legal  or  acquisition  expertise.  Eurther,  it 
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should  be  noted  that  the  data  eontained  in  the  survey  represent  the  individual  opinions 
and  impressions  of  the  respondents,  and  should  in  no  way  be  eonstrued  as  refleeting  an 
offieial  agency  position,  policy,  or  opinion. 
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IV.  SURVEY  RESULTS  AND  ANALYSIS 


A,  RESPONSE  RATE  AND  BACKGROUND  RESULTS 

Fifty-one  acquisition  and  legal  professionals,  across  twenty-two  federal  agencies 
were  asked  to  participate  in  the  survey.  Twenty-one  personnel,  representing  ten  federal 
agencies,  ultimately  participated  in  the  survey,  yielding  an  overall  response  rate  of  41%. 
Fourteen  respondents  (67%)  identified  themselves  as  acquisition  professionals,  while 
seven  respondents  (33%)  identified  themselves  as  legal  professionals.  These  results  are 
summarized  in  Figures  9  and  10. 


Surevey  Respondents 


Figure  9.  Survey  Respondent’s  Professional  Background 
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Respondents  By  Agency 


Department  of  State 
5% 


Apartment  of  the  Air 
Force 
9% 


Department  of  the  Navy 
(Navyand  Marine  Corps) 
52% 


Department  of 
Commerce 

4%  Department  of 

Defense  (DLA) 
5% 

\  Department  of 
^Education 
5% 

Department  of 
Energy 
5% 


lepartmentof 
Health  and 
Human 
Services 
5% 


Department  of 
Housingand  Urban 
Department  of  Justice  Development 

5°/°  5% 


Figure  10.  Survey  Respondents  by  Agency 

B.  STRATEGIES  AND  PRACTICES  TO  MINIMIZE  BID  PROTEST 

IMPACT 

1,  Most  Frequently  Cited  Strategies  and  Practices 

Given  a  list  of  thirty  different  strategies  and  practices  designed  to  minimize  the 
impact  of  protests  on  the  acquisition  system,  respondents  were  asked  to  rank  their 
agency’s  use  of  the  strategy  or  practice.  Amongst  all  respondents,  the  most  widely 
identified  strategy  and  practice  was  to  Set  in  advance  clear  and  publicly  disclosed 
evaluation  criteria  and  adhering  to  those  criteria  during  source  selection,  with  a  mean 
score  of  3.48.  The  second  most  cited  strategy  or  practice  was  Advanced  Acquisition 
Planning,  with  a  mean  score  of  3.38.  Agency  Procedures  to  prevent  fraud,  providing 
mandatory  quality  debriefings,  market  and  research  and  engagement  with  industry, 
agency  level  protests  procedures,  and  taking  early  corrective  actions,  are  also  highly 
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identified  strategies  and  practiees,  eaeh  of  which  had  a  mean  score  at  or  above  3.0.  The 
overwhelming  majority  of  respondents  cited  these  practices  with  either  moderate  or  great 
frequency.  The  remaining  three  strategies  have  a  score  above  2.7  and  below  3.0,  and 
include  independent  expert  reviews  by  task  order  ombudsmen  or  competition  advocates, 
independent  expert  reviews  by  federal  small  business  advocates,  and  greater  training  for 
acquisition  workforce.  Only  one  strategy,  taking  early  corrective  action,  can  be 
characterized  as  a  defensive  strategy;  the  rest  are  preventive.  Further,  almost  all 
preventive  strategies  involve  only  the  buying  agency’s  personnel,  which  can  reinforce 
agency  errors  or  violations  instead  of  correcting  them.  Overall,  this  data  suggests  that 
agencies  may  not  be  doing  all  they  can  or  should  to  actively  minimize  protest  costs  and 
delays  once  a  protest  is  fded.  The  top  ten  defensive/preventive  strategies  and  practices 
identified  are  summarized  in  Figure  1 1 . 
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Figure  11.  Top  Ten  Defensive/Preventive  Strategies  and  Praetiees  Identified 

2,  Least  Frequently  Cited  Strategies  and  Practices 

Strategies  and  praetiees,  sueh  as  refusing  to  follow  GAO  advisory  opinions  where 
the  GAO  sustains  the  protest  on  apparently  wrong  grounds,  vigorous  objections  and 
request  for  sanctions  in  response  to  frivolous  protests,  and  taking  corrective  actions 
involving  direct  awards  to  protesters,  instead  of  re-competitions  or  re-evaluations ,  taking 
express  option  requests  under  GAO  procedures  are  the  least  identified  amongst 
respondents,  with  a  mean  score  of  less  than  or  equal  to  1.7.  Independent  expert  reviews 
by  the  GAO  which  Executive  Branch  agencies  may  request  concerning  matters  of 
government  spending  under  Title  31,  Section  3529  of  the  United  States  Code,  other 
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strategies  (to  be  defined),  ADR  with  assistance  from  the  Court  of  Federal  Claims  or  the 
GAO  (such  as  GAO  outcome  prediction  or  negotiation  assistance),  corrective  actions 
involving  declaratory-type  relief/changes  to  agency  policies,  ADR  without  assistance 
from  the  GAO  or  the  Court  of  Federal  Claims,  and  overrides  based  on  best  interests  of 
the  United  States  (which  apply  only  to  post-award  and  competitive  range  protests)  all 
have  mean  seores  above  1.7  and  at  or  below  2.0.  The  majority  of  respondents  cite  these 
strategies  or  practices  as  being  used  rarely,  if  ever.  These  results  suggest  that  agencies 
would  rather  insulate  their  procurement  deeisions  from  outside  reviews  than  avoid 
protests.  Contrary  to  Exeeutive  Order  12979,  agencies  are  reluetant  to  engage  in  ADR 
(and,  therefore,  conduct  cost-benefit  analysis,  reeonsider,  or  bargain  over  their 
proeurement  decisions).  Agencies  are  reluetant  to  expedite  protest  litigation  and  cut  short 
the  protest  time  from  100  days  to  less  than  65  days.  At  the  same  time,  ageneies  are 
reluetant  to  risk  disputes  with  Congress  over  GAO’s  views  on  the  merits  of  the  ageney 
procurement  deeision  and  with  the  Court  of  Federal  Claims  over  the  need  to  keep  moving 
the  aequisition  programs  free  from  mandatory  stays.  However,  agencies  are  also 
reluctant  to  end  protests  by  rewarding  protesters  with  direct  contract  awards.  This 
provides  a  disincentive  to  protesters  seeking  an  easy  eontract  through  litigation.  Figure 
12  summarizes  the  ten  least  identified  practiees  and  strategies. 
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Figure  12.  Ten  Least  Cited  Defensive/Preventive  Strategies  and  Praetiees 


C.  USE  OF  ADR  PROCEDURES  TO  RESOLVE  BID  PROTESTS 

In  general,  survey  respondents  seem  to  believe  that  ADR  proeedures  are 
infrequently  used  to  resolve  bid  protests  within  their  ageneies.  This  appears  to  contradict 
Executive  Order  No.  12979,  which  directs  agencies  to  use  to  them  to  the  maximum  extent 
practicable.  The  mean  score  of  the  eleven  ADR  procedures  respondents  were  able  to 
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choose  from  was  1.55,  indicating  that  respondents  believe  their  agency  rarely,  if  ever, 
utilize  ADR  procedures  to  resolve  bid  protests.  The  highest  rated  ADR  procedure  was 
negotiation,  with  a  mean  score  of  2.24,  implying  that  the  majority  of  respondents  believe 
their  agency  utilized  this  procedure  to  at  least  some  extent.  All  other  ADR  procedures 
scored  at  or  below  1.87.  Other  ADR  procedures  between  the  highest  and  the  least  used, 
in  descending  order,  include:  GAO  outcome  prediction,  conciliation,  GAO  negotiation 
assistance,  hybrid  techniques,  ADR  with  the  assistance  of  the  Court  of  Federal  Claims, 
mediation,  summary  trial  by  a  Board  of  Contract  Appeals,  mini-trial,  and  arbitration. 
The  least  identified  named  ADR  procedure  was  evaluation  by  third-party  neutrals,  with  a 
mean  score  of  1.29,  implying  that  respondents  believe  this  procedure  is  almost  never 
utilized  by  their  agency.  Other  (to  be  defined)  techniques  had  the  score  of  1.20.  These 
findings  are  somewhat  surprising.  Intuitively,  ADR  should  be  favored  by  agencies 
concerned  over  costs  or  delays  because  engaging  in  ADR  would  enable  the  agency  to 
conduct  a  cost-benefit  analysis  of  its  alternatives  in  the  face  of  a  protest  and  to  bargain 
with  the  protester  over  these  costs,  benefits,  and  alternatives.  Further,  new  processes  of 
re-evaluation  and  reconsideration  of  procurement  decisions  are  inherent  in  the  very 
nature  of  ADR.  This  is  because,  as  recommended  by  the  U.S.  Department  of  Justice 
Electronic  Guide  to  Federal  Procurement  ADR,  effective  protest  ADR  requires  an 
agency  to  conduct  some  fact-finding  and  a  risk  assessment  involving  strengths  and 
weaknesses  of  agency  position.  This  process  may  be  guided  or  refereed  by  a  neutral 
person.  Survey  data  above  on  the  most  and  least  cited  defensive/preventive  strategies  and 
practices  shows  that  directed  awards  to  protesters  are  rare  -  implying  that  new  process  is 
what  the  protester  are  most  likely  to  get  as  relief.  Logically,  as  a  matter  of  sound 
business  management,  agencies  should  make  frequent,  formal  decisions  to  pursue  ADRs 
of  all  types  as  their  most  frequently  used  defensive  strategies.  Instead,  the  two  most 
favored  ADR  measures  are  the  least  structured  (negotiation)  and  the  least  ADR-ltke  in 
terms  of  time  and  cost  impact  (GAO  outcome  prediction).  Figure  13  summarizes 
respondents’  beliefs  of  their  agency’s  use  of  ADR  procedures  to  resolve  bid  protests. 
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Figure  13.  The  Use  of  ADR  Procedures  to  Resolve  Bid  Protests 

D.  ASPECTS  OF  CURRENT  POLICIES,  PRACTICES,  LAWS,  OR 
REGULATIONS  THAT  PRECLUDE  EFFECTIVE  RESOLUTION  OF 
PROTESTS 

1,  Most  Frequently  Cited  Policies,  Practices,  Laws,  or  Regulations 

When  asked  to  rate  a  list  of  twenty  policies,  practices,  and  laws,  respondents 
overwhelmingly  noted  the  lack  of  fiscal  disincentives  for  unjustified  protests  as  the 
predominant  policy  factor  that  they  believe  precludes  or  prevents  the  effective  resolution 
of  bid  protests.  With  a  mean  score  of  3.20,  the  majority  of  respondents  feel  this  policy 
precludes  effective  resolution  to  at  least  a  moderate  extent.  Similar  responses  were  found 
for  factors,  such  as  poor  acquisition  planning  and  lack  of  properly  trained  acquisition 
workforce,  with  mean  scores  of  3.10  and  3.0,  respectively.  Lack  of  formal  sanctions  at 
the  GAO  for  frivolous  protests,  strategic  behavior  by  disappointed  bidders  seeking  to 
recover  bid  and  proposal  costs  without  basis  for  award,  frivolous  protest  filings,  failure 
to  maintain  adequate  documentation  of  procurement  decisions,  failure  to  assure 
adherence  to  stated  evaluation  criteria,  delay-seeking  strategies  by  incumbents  without 
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basis  for  new  awards,  and  poorly  designed  or  implemented  cost  estimates  all  had  mean 
scores  from  2.88  to  2.39,  respectfully.  Presently,  the  GAO  does  not  impose  monetary  or 
other  sanctions  for  frivolous  protests  such  as  those  imposed  under  Rule  1 1  of  the  Court  of 
Federal  Claims.  However,  as  previously  shown  in  Figure  8,  the  GAO  does  dismiss 


frivolous  protests.  Figure  14  lists  the  respondents’  top  ten  policies,  practices,  or  laws  that 


they  believe  preclude  effective  avoidance  or  resolution  of  protests. 
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Figure  14.  Top  Ten  Policies,  Practices  or  Laws  that  Preclude  Effective  Avoidance  or 

Resolution  of  Protests 


2,  Least  Frequently  Cited  Policies,  Practices,  Laws,  or  Regulations 

Factors,  such  as  a  lack  of,  or  deficiencies  in,  agency-level  bid  protest  procedures, 
regulatory  or  statutory  provisions  discouraging  ADR,  and  other  deficiencies  in  ADR 
procedures,  were  the  lowest  rated  factors  with  mean  scores  of  less  than  1.5,  implying  that 
respondents  believe  these  factors  rarely,  if  ever,  preclude  effective  avoidance  or 
resolution  of  bid  protests.  A  possible  conclusion  from  this  data  is  that  there  exists  an 
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institutional  lack  of  will  to  utilize  ADR  procedures.  Other  least  eited  faetors,  with  mean 
seores  between  1.71  and  2.35,  inelude  agency  reluctance  or  failure  to  seek  stay  overrides, 
agency  reluctance  to  seek  express  option,  agency  reluctance  to  deviate  from  GAO 
recommendation,  other  aspects  (to  be  defined),  failure  to  assure  fair  discussions  with 
offerors,  and  poor  debriefings.  This  suggests  that  respondents  do  not  regard  unfair, 
unequal,  or  incomplete  communications  with  offerors  or  agencies’  failure  to  use  available 
tools  to  expedite  programs  during  protests  as  making  significant  contributions  to  protest 
burdens  experienced  by  agencies.  Figure  15  displays  the  ten  least  prevalent  factors 
identified  by  survey  respondents  that  preelude  effeetive  avoidance  or  resolution  of 
protests. 
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Figure  15.  Ten  Least  Utilized  Factors  Precluding  Effective  Avoidance  or  Resolution  of  Bid 

Protests 
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E. 


FURTHER  ANALYSIS  OF  RESULTS 


1,  Introduction 

Thus  far,  results  have  been  presented  in  terms  of  mean  results  and  overall  trends 
from  all  respondents.  However,  survey  respondents  represent  a  diverse  set  of  agencies, 
and  have  differing  professional  responsibilities.  Both  military  and  civilian  agencies  are 
represented  in  the  survey  sample,  as  are  both  legal  and  acquisition  professionals.  It  is, 
therefore,  worthwhile  to  consider  how,  or  if,  these  factors  in  anyway  influence  survey 
results.  The  following  paragraphs  compare  civilian  versus  military  perspectives  and 
acquisition  versus  legal  perspectives. 

2,  Civilian  vs.  Military  Perspective 

In  general,  respondents  representing  both  civilian  and  military  agencies  believe 
their  agencies,  utilize  with  at  least  moderate  frequency,  a  number  of  preventive  or 
defensive  strategies  and  practices  to  minimize  the  possible  negative  impacts  of  bid 
protests  on  the  acquisition  system.  Further,  there  is  a  striking  similarity  between  the  most 
frequently  identified  practices  and  strategies  employed  by  respondents  representing  both 
civilian  and  military  agencies.  Figure  16  compares  the  top  ten  strategies  identified  by 
respondents  representing  civilian  agencies  with  the  corresponding  military  agency  score. 
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Figure  16.  Top  Ten  Civilian  Agency  Strategies  Compared  to  Military  Agencies 
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With  respect  to  the  utilization  of  ADR  practices  to  minimize  the  effect  of  bid 
protests,  both  groups  of  respondents  indicated  similar  beliefs  about  the  utilization  of 
various  ADR  practices  within  their  agency.  In  general,  respondents  seem  to  believe  that 
neither  civilian  nor  military  agencies  utilize  ADR  practices  to  a  great  extent. 
Nonetheless,  it  appears  respondents  representing  civilian  agencies  generally  cite  their 
agency’s  use  of  negotiation  to  a  greater  extent  than  their  military  counterparts,  with  mean 
scores  for  this  technique  of  2.57  and  2.00,  respectively.  This  finding  is  inconsistent  with 
the  tenets  of  E.O.  12979,  the  FAR  requirement  for  all  parties  to  “use  their  best  efforts  to 
resolve  concerns  raised  by  an  interested  party  at  the  contracting  officer  level  through 
open  and  frank  discussions,”^^  and  the  direction  of  then-Undersecretary  of  Defense  John 
Young  and  then-Deputy  Assistant  Secretary  of  the  Navy  for  Acquisition  and  Logistics 
Management  RDML  Sean  Crean  for  greater  government-industry  communications  as  a 
way  to  avoid  bid  protests.  Civilian  agencies  also  topped  their  military  counterparts  in 
utilizing  GAO  outcome  prediction,  ADR  with  the  assistance  of  the  Court  of  Federal 
Claims,  and,  barely,  with  respect  to  mini-trials.  On  the  other  hand,  military  agencies 
topped  civilian  agencies  in  the  use  of  GAO  negotiation  assistance,  conciliation, 
mediation,  summary  trials  by  the  Board  of  Contract  Appeals,  hybrid  techniques,  other 
techniques  (to  be  defined),  and,  barely,  evaluation  by  third-party  neutrals.  On 
arbitration,  the  civilian  and  military  agencies  were  equal.  This  suggests  that,  when 
military  agencies  actually  use  ADR,  they  are  much  more  creative  with  their  ADR 
approaches  than  civilian  agencies.  However,  negotiation  was  the  only  ADR  technique 
was  cited  by  the  military  with  a  mean  score  of  equal  or  over  2.0.  This  suggests  that 
overall  use  of  ADR  in  military  agencies  is  very  low.  Figure  17  compares  the  civilian 
agency  respondent’s  identification  of  ADR  procedures  with  those  of  respondents 
representing  military  agencies. 


Federal  Aequisition  Regulation  33.103(b). 
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Figure  17.  Comparison  of  Civilian  Agency  use  of  ADR  Procedures  with  Military  Agencies 


Amongst  both  groups  of  respondents  there  seems  to  be  a  strong  similarity 
between  their  view  of  policies,  practices,  laws,  and  regulations  that  preclude  effective 
avoidance  or  resolution  of  bid  protests.  Both  groups  of  respondents  cite  the  lack  of  fiscal 
disincentives  for  unsuccessful  protests  as  the  most  prevalent  factor  precluding  effective 
resolution  or  avoidance  of  protests.  Both  groups  also  cite  poor  acquisition  planning  and 
the  lack  of  adequately  trained  acquisition  personnel  as  significant  factors  in  precluding 
the  effective  resolution  or  avoidance  of  protests.  However,  there  is  a  strong  difference 
regarding  the  frequency  with  which  respondents  believe  agency  reluctance  to  seek  award 
stay  overrides  precludes  effective  resolution  or  avoidance  of  bid  protests.  Amongst 
military  respondents,  the  mean  score  for  this  factor  is  2.13  compared  to  1.17  for  civilian 
respondents.  Although  the  military  score  is  still  low,  indicating  respondents’  belief  that 
this  factor  prevents  effective  avoidance  or  resolution  of  protests  relatively  infrequently,  it 
nonetheless  raises  a  number  of  possible  implications.  It  is  possible  that  military  agencies 
are  less  inclined  to  seek  overrides  of  mandatory  procurement  stays  than  their  civilian 
counterparts.  If  time  delays  associated  with  a  bid  protest  are  in  fact  impeding  mission 
accomplishments,  then  agencies  should  seek  overrides  in  the  best  interests  of  the  United 
States,  consistent  with  FAR  Part  33.104(c).  In  terms  of  the  most  frequently  cited  reasons 
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precluding  effective  protest  resolution,  factors  such  as  lack  of  properly  trained 
acquisition  workforce,  strategic  behavior  by  disappointed  offerors  with  no  legitimate 
basis  for  award  in  order  to  recover  bid  and  proposal  costs,  lack  of  formal  sanctions  at 
the  GAO  for  frivolous  protests,  frivolous  protest  filings,  and  failure  to  assure  adherence 
to  stated  evaluation  criteria  are  comparatively  greater  problems  for  military  agencies. 
For  civilian  agencies,  comparatively  greater  problems  include  lack  of  fiscal  disincentives 
for  unjustified  protests  such  as  “loser  pays  ”  arrangements,  poor  acquisition  planning, 
delay-seeking  strategies  by  incumbent  contractors  who  have  no  legitimate  basis  for 
renewed  award,  and  poor  debriefings.  Figure  18  compares  the  ten  most  frequently 
identified  responses  of  civilian  agency  respondents  with  those  from  military  agencies. 
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Figure  18.  Comparison  of  Ten  Most  Frequently  Identified  Civilian  and  Military  Agency 
Perception  of  Processes,  Laws,  Policies,  or  Regulations. 

Military  agencies  cite  comparatively  lower  problems  with  failure  to  assure  fair 
discussions  with  offerors.  On  the  other  hand,  civilian  agencies  cite  comparatively  lower 
problems  with  all  other  categories,  including  regulatory  or  statutory  provisions 
discouraging  ADR,  other  aspects  (to  be  defined),  other  deficiencies  in  the  ADR  process, 
agency  reluctance/failure  to  seek  award  stay  overrides,  lack  of,  or  deficiencies,  in  agency 
level  protest  procedures,  agency  reluctance  to  seek  express  options  in  protests,  agency 
reluctance  to  deviate  from  GAO  recommendations,  and  properly  designed  or  executed 
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cost  evaluations.  For  the  military  agencies,  agency  reluctance/failure  to  seek  award  stay 
overrides,  agency  culture  that  discourages  ADR  or  reconsideration  of  award  decisions, 
lack  of,  or  deficiencies  in,  agency-level  bid  protest  procedures,  and  agency  reluctance  to 
deviate  from  GAO  recommendations  seem  to  be  much  more  prevalent  or  significant  than 
for  civilian  agencies.  Figure  19  compares  the  ten  least  frequently  identified  responses  of 
civilian  agency  respondents  with  those  from  military  agencies. 
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Figure  19.  Comparison  of  Ten  Least  Frequently  Identified  Civilian  and  Military  Ageney 
Pereeption  of  Proeesses,  Laws,  Polieies,  or  Regulations  vs.  Military  Ageneies. 

3,  Acquisition  vs.  Legal  Perspective 

When  eomparing  the  perspeetive  of  respondents  employed  as  legal  professionals 
with  that  of  respondents  employed  as  aequisition  professionals,  there  is  mueh  similarity 
in  opinion  with  regard  to  their  beliefs  about  the  use  of  preventive  or  defensive  strategies 
designed  to  minimize  the  negative  impacts  of  bid  protests  on  the  acquisition  process. 
Despite  this  strong  similarity  in  response,  there  are  a  few  notable  exceptions  that  bear 
mentioning.  Acquisition  professionals  cite  a  higher  instance  of  using  non-mandatory 
debriefings  to  unsuccessful  offerors.  The  mean  score  for  this  factor  amongst  acquisition 
professionals  was  3.14,  compared  to  a  mean  score  of  2.40  for  legal  professionals. 
Similarly,  acquisition  professional  respondents  indicate  that  they  believe  their  agencies 
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tend  to  take  eorreetive  aetion  to  inelude  involving  the  protestor  as  a  subeontraetor  or 
member  of  the  winning  team(s)  to  a  greater  extent  than  legal  professionals  would  seem  to 
indicate.  The  mean  score  for  this  factor  was  2.50  for  acquisition  professionals,  while  it 
was  only  1.83  for  legal  professionals.  Legal  professionals  identified  advance  acquisition 
planning,  thorough  market  research  and  engagement  with  industry,  greater  training  for 
acquisition  workforce,  hiring  or  assigning  additional  acquisition  workforce  and 
awarding  extensions  or  bridge  contractors  to  incumbents  protesting  re-competitions 
more  often  than  acquisition  professionals.  The  opposite  relationship  was  for  factors 
including  setting  in  advance  clear  and  publicly  disclosed  evaluation  criteria  and 
adhering  to  these  criteria  during  evaluation,  providing  quality  mandatory  debriefings  to 
offerors,  agency  procedures  to  prevent  fraud,  procurement  integrity,  or  organizational 
conflict  of  interest  violations,  and  agency-level  protest  procedures.  Both  groups  cited 
taking  early  corrective  action  with  the  same  frequency.  Figure  20  compares  the  ten  most 
frequently  identified  practices  of  legal  professionals  with  those  of  acquisition 
professionals. 
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Figure  20.  Comparison  of  Ten  Most  Frequently  Identified  Strategies  and  Practices  Identified 
by  Legal  Professionals  with  those  of  Acquisition  Professionals. 

Legal  professionals  identified  strategies  and  practices  such  as  acquisition 
strategies  involving  shorter-term  contracts,  taking  corrective  actions  involving 
declaratory-type  relief  such  as  changes  to  agency  policies,  seeking  best  interest 
overrides,  taking  corrective  actions  involving  inclusion  of  protesters  as  subcontractors  or 
members  of  winning  teams,  independent  expert  reviews  by  the  GAO,  and  other  strategies 
(to  be  defined)  less  often  than  acquisition  professionals.  The  relationship  was  reversed 
for  strategies  such  as  refusal  to  follow  erroneous  GAO  views,  vigorous  objections  and 
requests  for  sanctions  with  respect  to  frivolous  protests,  and  express  options.  Both  sides 
were  equally  low  on  corrective  actions  involving  direct  awards  to  protesters. 
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Figure  21  compares  the  ten  least  identified  strategies  and  practices  of  legal 
professionals  with  those  of  acquisition  professionals. 
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Figure  21 .  Comparison  of  Ten  Least  Frequently  Identified  Strategies  and  Practices  Identified 
by  Legal  Professionals  with  those  of  Acquisition  Professionals. 

Amongst  legal  and  acquisition  respondents,  the  most  divergent  opinions  on  ADR 
related  to  the  use  of  ADR  procedures  to  resolve  bid  protests.  When  asked  to  rate  their 
agency’s  use  of  eleven  different  ADR  procedures,  the  mean  score  amongst  legal 
respondents  was  1.78,  whereas  the  mean  score  amongst  acquisition  respondents  was  1.39. 
This  data  indicates  that  ADR  is  not  being  employed  to  great  effect  to  reduce  costs  and 
program  delays.  Since  ADR  begins  at  the  agency  level,  its  lack  of  use  is  surprising. 
Acquisition  managers  have  a  desire  to  minimize  cost  and  time  delays,  yet  they  are  under¬ 
utilizing  a  valuable  tool  to  help  them  in  that  regard.  While  these  results  indicate  that 
ADR  procedures  are  not  employed  with  great  frequency  to  resolve  protests,  a  few 
specific  areas  are  worth  noting.  When  asked  to  rate  their  agency’s  use  of  negotiation  as  a 
technique  to  resolve  bid  protests,  legal  respondents  had  a  mean  score  of  2.70  compared  to 
a  mean  score  of  2.0  for  acquisition  respondents.  Similarly,  when  asked  to  rate  their 
agency’s  use  of  conciliation  as  a  technique  to  resolve  bid  protests,  legal  respondents  had 
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a  mean  score  of  2.20  compared  to  a  mean  score  of  1.33  for  acquisition  respondents. 
These  scores  reflect  the  opinions  of  the  respondents  and  are  not  necessarily  reflective  of 
actual  agency  behavior.  Nonetheless,  the  scores  provide  significant  insight  into  how 
various  personnel  within  an  agency  perceive  the  use  of  ADR  techniques.  Lawyers  also 
seem  to  participate  more  often  in  GAO  outcome  prediction,  GAO  negotiation  assistance, 
ADR  with  the  assistance  of  the  Court  of  Federal  Claims,  hybrid  techniques,  summary 
trials  at  the  Board  of  Contract  Appeals,  evaluation  by  third-party  neutrals,  mini-trials, 
other  ADR  (to  be  defined),  and  arbitrations  than  acquisition  officials.  Only  for  mediation 
is  the  frequency  reversed.  It  appears  that,  in  contrast  to  lawyers,  agency  acquisition 
officials  rarely  become  involved  in  ADR  in  resolving  bid  protests.  Figure  22  compares 
the  survey  results  of  respondents  with  a  legal  background  to  those  of  respondents  with  an 
acquisition  background. 
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Figure  22.  Comparison  of  Legal  and  Acquisition  Perspective  on  the  use  of  ADR  Procedures 

to  resolve  Bid  Protests. 

In  general,  both  acquisition  and  legal  respondents  seem  to  have  similar 
perceptions  regarding  the  aspects  of  processes  policies,  practices,  laws,  or  regulations  that 
preclude  effective  avoidance  or  resolution  of  bid  protests.  Yet  despite  the  similarity  of 
opinion,  the  data  provides  some  insight  into  the  attitudes  and  perception  of  both  parties. 
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Overwhelmingly,  legal  respondents  eite  poor  acquisition  planning  as  the  aspeet  or  poliey 
that  most  often  preeludes  effeetive  avoidanee  or  resolution.  The  mean  seore  of  legal 
respondents  for  this  partieular  faetor  was  3.29,  indieating  that  they  believe  this  factor 
precludes  effective  avoidance  or  resolution  of  protests  with  at  least  moderate  frequency. 
Comparatively,  respondents  with  an  acquisition  background  also  cite  this  factor  as 
precluding  effective  resolution  or  avoidance  of  bid  protests,  albeit  to  a  lesser  extent,  with 
a  mean  score  amongst  respondents  of  3.00.  The  factor  identified  as  precluding  effective 
avoidance  or  resolution  of  protests  to  the  greatest  extent  by  respondents  with  an 
acquisition  background  was  the  lack  of fiscal  disincentives  for  unjustified  protests,  with  a 
mean  score  of  3.50.  However,  respondents  with  a  legal  background  scored  this  factor 
slightly  lower,  with  a  mean  score  of  2.83.  Lawyers  also  cited  in  with  greater  frequency 
than  acquisition  professionals  such  aspects  or  policies  such  as  lack  of  properly  trained 
acquisition  workforce,  failure  to  maintain  adequate  documentation  of  procurement 
decisions,  and  strategic  behavior  by  disappointed  offerors  with  no  basis  for  award 
seeking  to  recover  bid  and  proposal  costs.  On  the  other  hand,  acquisition  professionals 
also  cited  lack  of  formal  sanctions  at  the  GAO  for  frivolous  protests,  frivolous  protest 
filings,  and  delay-seeking  strategies  by  incumbents  who  have  no  legitimate  basis  for 
renewed  award.  This  comparison  suggests  that  agency  lawyers  generally  do  not  share 
the  view  of  agency  acquisition  officials  concerning  the  extent  of  compliance  of  agency 
procurement  practices  with  procurement  laws  and  regulations.  Figure  23  compares  the 
ten  most  frequently  identified  factors  that  preclude  effective  resolution  or  avoidance  of 
bid  protests  between  acquisition  and  legal  respondents. 
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Figure  23.  Comparison  of  Ten  Most  Frequently  Identified  Acquisition  and  Legal 
Professionals  Views  on  Factors  that  Preclude  Effective  Resolution  or  Avoidance  of  Bid 

Protests. 

Across  the  board,  legal  professionals  seem  to  believe  more  than  acquisition 
professionals  that  all  least-cited  factors  except  for  other  deficiencies  in  ADR  process  (to 
be  defined)  can  have  greater  detrimental  impact  on  effective  resolution  of  bid  protests. 
For  lawyers,  the  least  cited  factors  range  from  the  lowest  of  other  deficiencies  in  ADR  ( to 
be  defined)  and  regulatory/statutory  provisions  discouraging  ADR,  to  agency  culture  that 
discourages  ADR  or  reconsideration  of  decisions,  to  agency  reluctance  to  seek  express 
option,  to  lack/deficiencies  in  agency-level  protests,  to  agency  reluctance  to  deviate  from 
GAO  recommendations,  to  agency  reluctance  to  seek  stay  overrides,  to  failure  to  assure 
timely  discussion  with  offerors,  to  poor  debriefings.  For  acquisition  professionals,  these 
factors  range  from  the  lowest  of  other  deficiencies  in  ADR  (to  be  defined),  to  regulatory 
or  statutory  provisions  discouraging  ADR,  to  agency  culture  discouraging  ADR,  to 
agency  reluctance  to  seek  express  options,  to  lack/deficiencies  in  agency-level  protests,  to 
agency  reluctance  to  deviate  from  GAO  recommendations,  to  agency  reluctance  to  seek 
stay  overrides,  to  failure  to  assure  fair  discussions,  to  poor  debriefings.  Figure  24 
compares  the  ten  least  frequently  identified  factors  that  preclude  effective  resolution  or 

avoidance  of  bid  protests  between  acquisition  and  legal  respondents. 
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Figure  24.  Comparison  of  Ten  Least  Frequently  Identified  Acquisition  and  Legal 
Professionals  Views  on  Factors  that  Preclude  Effective  Resolution  or  Avoidance  of  Bid 

Protests. 


4,  Additional  Considerations 

In  addition  to  the  inherent  value  of  the  perceptions,  views,  and  opinions  offered 
by  respondents,  there  is  additional  value  in  analyzing  the  nature  of  their  responses.  The 
first  survey  question  asked  respondents  to  identify  to  what  they  believe  to  be  the 
frequency  of  their  agency’s  use  of  various  preventive  and  defensive  strategies  to 
minimize  the  negative  impact  of  bid  protests.  The  third  question  asked  respondents  to 
identify  the  frequency  with  which  they  believe  aspects  of  current  policies,  practices,  laws, 
or  regulations  preclude  effective  resolution  or  avoidance  of  protests.  Conceptually,  these 
two  questions  can  be  viewed  as  trying  to  identify  two  distinct  ideas.  First,  what  do 
agencies  do  to  minimize  the  impact  of  bid  protests,  and  secondly  what  factors  prevent 
effective  resolution  of  protests? 

Intuitively,  one  expects  that  the  some  of  the  responses  to  these  questions  are  in  at 
least  some  way  related.  If,  respondents  believe  that  poor  acquisition  planning  is  the 
factor  that  most  frequently  prevents  the  effective  resolution  of  bid  protests  within  their 
agency  then  it  stands  to  reason  that  respondents  should  also  believe  that  the  preventive 
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strategy  or  practice  of  advanced  acquisition  planning  is  employed  infrequently  within 
their  agency.  Conversely,  if  respondents  believe  advanced  acquisition  planning  is 
almost  always  used  as  a  preventive  strategy  or  practice  within  their  agency,  then  one 
should  believe  poor  acquisition  planning  rarely,  if  ever,  is  a  factor  that  precludes 
effective  resolution  or  avoidance  of  bid  protests  in  their  agency.  Other  factors, 
specifically  those  that  relate  to  frivolous  protests,  acquisition  workforce  training, 
debriefings,  and  agency  level  protest  procedures  have  logical  relationships  as  well. 
Figure  25  displays  the  mean  respondent  answer  to  the  question  about  a  specific  strategy 
or  practice  and  compares  that  result  to  the  mean  respondent  answer  to  the  corresponding 
question  about  a  process  or  policy  that  precludes  effective  resolution  or  practice. 
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Figure  25.  Comparison  of  Agency  Defensive  Strategies  and  Processes  that  Preclude 

Effective  Resolution  of  Protests 


The  results  of  this  comparison  are  varied.  Some  of  the  results  are  quite  intuitive, 
while  others  are  not  so  intuitive,  and  may  require  further  research.  When  asked  to 
evaluate  the  extent  to  which  frivolous  protest  preclude  effective  resolution  or  avoidance 
of  protests  at  their  agency,  the  mean  respondent  score  was  2.83.  This  indicates  that  they 
believe  frivolous  protests  may  preclude  effective  resolution  or  avoidance  of  protests  to  a 
moderate  extent.  A  natural  strategy  for  an  agency  wishing  to  counteract  a  frivolous 
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protest  would  be  to  vigorously  object  to  the  protest  and  request  sanctions  in  response  to 
the  protest.  However,  amongst  survey  respondents,  this  strategy  had  a  mean  score  of 
1.67.  Indicating  that  respondents  believe  their  agencies  only  uses  this  particular  strategy 
in  rare  instances.  It  is  certainly  possible  that  if  respondent  agencies  utilized  a  more 
vigorous  approach  in  objecting  to  bid  protests  that  the  effect  frivolous  protests  have  on 
precluding  effective  resolution  would  decrease. 

Similarly,  respondents  indicated  on  average,  that  they  believe  their  agencies 
utilize  quality  mandatory  debriefings  with  a  fairly  high  degree  of  frequency.  The  mean 
score  amongst  respondents  for  this  strategy  was  3.3.  In  comparison,  on  average, 
respondents  indicated  that  they  believe  poor  debriefings  prevent  effective  resolution  or 
avoidance  of  protests  rarely.  The  mean  score  for  this  practice  was  2.35.  If  in  fact, 
agencies  are  providing  quality  debriefings  to  unsuccessful  offerors,  then  there  should  be 
very  few  instances  where  a  poor  debriefing  has  prevented  or  precluded  the  effective 
resolution  or  avoidance  of  a  protest.  Respondent  answers  to  the  survey  seem  to  support 
this  conclusion. 

On  average,  respondents  indicated  that  they  believe  greater  training  for  the 
acquisition  workforce  is  a  strategy  employed  by  their  agency  to  minimize  the  impact  of  a 
bid  protest  with  somewhat  less  than  moderate  frequency.  The  mean  score  for  this  factor 
was  2.71.  Similarly,  respondents  indicated  that  they  believe  the  lack  of  a  properly 
trained  acquisition  workforce  is  a  practice  that  precludes  effective  protest  resolution  with 
moderate  frequency.  The  mean  score  amongst  respondents  for  this  factor  was  3.0.  The 
implication  here  is  somewhat  obvious,  nonetheless  it  bears  stating  explicitly.  Greater 
training  for  the  acquisition  workforce  could  likely  result  in  fewer  instances  where  a 
poorly  trained  workforce  is  a  factor  that  precludes  effective  resolution  of  protests. 

Other  results  of  this  comparison  were  not  so  consistently  logical.  Advance 

acquisition  planning  was  cited  with  extremely  high  frequency  by  survey  respondents. 

This  indicates  that  they  believe  their  agency  employs  this  particular  strategy  quite  often 

as  a  means  to  prevent  or  avoid  a  bid  protest.  The  mean  score  amongst  respondents  for 

this  factor  was  3.38.  However,  respondents  also  cited  poor  acquisition  planning  with 

relatively  high  frequency.  The  mean  score  amongst  respondents  for  this  factor  was  3.10, 
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indicating  that  respondents  believe,  in  many  instanees,  their  ageney  is  preeluded  from 
effeetively  resolving  or  avoiding  protests  beeause  of  poor  acquisition  planning.  In  this 
regard  the  results  are  eounterintuitive.  If  in  faet,  good  advanced  acquisition  planning  is 
happening  on  a  regular  basis,  then  it  would  seem  diffieult  to  eonelude  that  poor 
acquisition  planning  is  one  of  the  most  frequent  praetiees  that  preeludes  effeetive 
resolution  or  avoidanee  of  protests.  This  may  aetually  be  a  ease  of  pereeption,  rather 
than  reality.  Quite  possibly,  respondents  feel  that  aequisition  planning  is  a  eonsistently 
employed  praetiee  within  their  ageney,  when  in  faet  it  is  not.  Or  eonversely,  respondents 
may  feel  that  poor  aequisition  planning  is  the  most  eommon  praetiee  that  preeludes 
effeetive  protest  resolution  when  in  faet  there  are  other  faetors  that  preelude  effeetive 
protest  resolution  to  a  greater  extent. 

F.  FURTHER  IMPLICATIONS 

In  general,  the  two  negative  externalities  (from  the  ageney  perspeetive)  assoeiated 
with  a  bid  protest  are  program  delay  and  inereased  eosts.  In  order  to  eounteraet  eaeh  of 
these  two  negative  externalities,  there  are  a  number  of  strategies  an  ageney  ean  employ. 
Sueh  strategies  as  utilizing  GAO’s  express  option,  ageney  override  of  mandatory  GAO 
stays,  early  eorreetive  aetion,  and  vigorous  objeetion  to  frivolous  or  meritless  protests  are 
a  number  of  strategies  that  if  effeetively  employed,  eould  potentially  reduee  the  delays 
assoeiated  with  a  bid  protest.  Figure  26  eompares  the  relative  frequeney  with  whieh 
respondents  believe  their  ageneies  use  a  number  of  these  strategies  to  eounteraet  delays 
eaused  by  bid  protests. 
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Figure  26.  Relative  Identifieation  of  Defensive  Strategies  used  to  Counteract  Delays  Caused 

by  Bid  Protests 


The  data  clearly  shows  that  respondents  believe  their  agencies  utilize  strategies 
such  as  agency-level  bid  protest  procedures  and  taking  early  corrective  action  with  fairly 
high  frequency.  However  strategies  such  as  taking  express  requests  under  GAO 
procedures,  vigorous  objections  and  requests  for  sanctions  in  response  to  frivolous 
protests,  and  refusal  to  follow  GAO  advisory  opinions  and  recommendations  (where  the 
GAO  sustains  a  protest  on  apparently  wrong  grounds)  are  identified  infrequently.  This 
implies  that  agencies  may  be  under-utilizing  some  of  the  tools  they  possess  to  counteract 
the  delays  associated  with  bid  protests. 

Similarly,  agencies  have  a  number  of  strategies  they  can  employ  to  reduce  the 
costs  associated  with  bid  protests.  Actions  such  as  negotiation,  use  of  ADR  procedures, 
early  corrective  action,  and  vigorous  objections  to  frivolous  protests,  are  but  a  number  of 
strategies,  that  if  effectively  employed  have  the  potential  to  reduce  costs.  Each  of  these 
processes  potentially  results  in  a  resolution  of  the  protest  prior  to  formal  adjudication.  As 
a  result,  agencies  may  be  able  to  avoid  paying  bid/proposal  costs  and  legal  fees  to  a 


48 


protestor.  Figure  27  compares  the  relative  frequency  with  which  respondents  believe 
their  agencies  use  a  number  of  these  strategies  to  reduce  costs  associated  with  by  bid 
protests. 


(17)  Alternative  (18)  Alternative  (27)  Vigorous 

dispute  resolution  dispute  resolution  objections  and 
(ADR)  procedures  (ADR)  procedures  requests  for 
with  assistance  without  assistance  sanctions  in 
from  the  GAO  or  from  the  GAO  or  response  to 
the  Court  of  the  Court  of  frivolous  protests 
Federal  Claims  Federal  Claims 


(28)  Refusal  to  (19)  Taking  early  (4)  Negotiation 
follow  GAO  corrective  actions 
advisory  opinions 
and 

recommendations 
where  the  GAO 
sustains  a  protest 
on  apparently 
wrong  grounds 


(1)  GAO 
Negotiation 
Assistance 


Figure  27.  Relative  Identification  of  Defensive  Strategies  used  to  Reduce  Costs  Associated 

with  Bid  Protests 


From  this  data,  it  appears  that  beyond  taking  early  corrective  action,  respondents 
do  not  believe  their  agencies  use  any  of  the  aforementioned  strategies  with  great 
frequency.  The  implication  here  is  quite  the  same  as  with  program  delays.  It  appears  that 
agencies  may  not  be  effectively  utilizing  all  the  tools  they  have  to  reduce  the  costs 
associated  with  a  bid  protest. 

Beyond  strategies  to  reduce  costs  and  delays,  agencies  may  also  employ  strategies 
to  reduce  or  eliminate  a  disappointed  or  unsuccessful  offerors  inclination  to  protest  for 
strategic  business  reasons  (e.g.  to  gain  greater  insight  into  agency  selection  decisions  or 
greater  access  to  agency  information).  Quality  debriefings  and  acquisition  strategies  that 
involve  multiple  awards  have  the  potential  to  reduce  the  number  of  protests  filed,  that  are 
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motivated  in  part  on  strategic  business  decisions.  Figure  28  compares  the  relative 
frequency  with  which  respondents  believe  their  agencies  use  these  strategies  and 
practices. 
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Figure  28.  Relative  Identification  of  Defensive  Strategies  used  to  Reduce  Protestor’s 
Inclination  to  Protest  for  Strategic  Business  Reasons 

This  data  shows  that  respondents  believe  their  agencies  utilize  both  mandatory 
and  non-mandatory  debriefings  to  offerors  with  fairly  high  frequency.  However, 
respondents  seem  to  believe  that  acquisition  strategies  involving  multiple  contract 
awards  rather  than  “winner-takes-all”  consolidated  acquisitions  are  employed  less 
frequently.  To  the  extent  that  further  employment  of  such  an  acquisition  strategy  is 
practicable,  it  may  represent  an  opportunity  for  agencies  to  reduce  the  strategic  business 
reasons  behind  a  protestors  filing. 

G.  RESPONDENT  COMMENTS  AND  OPINIONS 

Survey  respondents  were  given  the  opportunity  to  provide  comments  regarding 
contractor  motivation;  to  initiate  protests  in  general,  to  file  protests  at  the  GAO,  under 
agency  level  programs,  at  the  Court  of  Federal  Claims,  to  challenge  an  agency’s  decision 
to  override  an  automatic  stay  at  the  Court  of  Federal  Claims,  and  to  resolve  protests 
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(5)  Acquisition  strategies  involving  multiple  (1 1)  Providing  quality  mandatory  debriefings  (14)  Providing  quality  non-mandatory 
contract  awards  rather  than  "winner-takes-  to  offerors  debriefings  to  offerors 

all"  consolidated  acquisitions 


through  ADR  procedures.  Respondents  were  also  offered  the  opportunity  to  provide 
suggestions  for  improvements  to  policies,  proeesses,  praetices,  laws  or  regulation.  The 
range  of  eomments  provided  was  quite  diverse.  The  following  paragraphs  summarize 
some  of  the  eommon  themes.  Additional  eomments  of  partieular  note  or  interest  are 
ineluded  as  well. 

Respondent  eomments  largely  fell  into  one  of  two  eategories:  eomments,  that 
involve  a  strategy  or  practiee,  and  comments  that  involve  a  policy,  regulation,  or  aspeet 
of  law.  In  regards  to  strategies  and  practiees,  that  could  potentially  reduee  the  negative 
impaet  of  bid  protests,  respondents  noted  issues  related  to  training  and  eommunieation, 
ineluding  the  benefits  of  a  quality  debriefing.  One  respondent  in  partieular  noted  the 
need  for  “improvements  in  the  quality,  eontent,  and  eontext  of  information  given  in 
award  debriefings  [as  a  means]  to  prevent  protests  that  are  filed  as  ‘fishing  expeditions’.” 

A  number  of  respondents  indieated  that  peer  reviews  were  praetiees  employed  by 
their  agency  to  minimize  the  negative  impaet  of  bid  protests.  Typieal  responses  ineluded 
eomments,  sueh  as  “Peer  reviews  at  all  levels... my  division  has  ineorporated  peer 
reviews  for  all  new  proeurements... above  Simplified  Aequisition  Proeedures  (SAP) 
threshold.”  Another  respondent  noted, 

Eaeh  aequisition  office  has  a  ‘peer’  type  of  eontraet  review  board,  whieh 
considers  planned  solicitations  and  contract  awards  over  specific 
thresholds.  Senior  Procurement  Exeeutive  reviews  all  aequisition  plans 
exeeeding  $10M  and  a  formal  Investment  Review  Board,  ineluding 
aequisition  representation,  review  planned  aequisitions  over  $75M. 

Respondents  eite  protestor  familiarity  with  GAO  proeesses,  protestor’s  belief  in 
GAO’s  independenee,  and  the  relative  inexpensiveness  of  filing  and  litigating  at  GAO,  as 
primary  reasons  why  protestors  eleet  to  file  protests  with  the  GAO.  Respondents  also 
made  a  number  of  eomments  regarding  ageney  level  protest  proeedures.  The  majority  of 
eomments  seem  to  indieate  that  trust  is  a  major  faetor  in  the  sueeess  of  an  ageney  level 
protest  forum.  Namely,  protestors  must  trust  that  agencies  will  be  able  to  set  aside  any 
ageney  bias  and  issue  deeisions  in  a  fair,  impartial,  and  equitable  manner.  Comments 
eontained  in  Eigure  29  seem  to  indicate  that  respondents  believe  protestors  do  not  have 


suffieient  trust  in  ageney  level  protest  forums. 
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Please  briefly  describe  any  factors  that,  in  your  experience,  motivate  or  constrain  a  contractors'  decisions 

to: 

protest  under  your  agency's  agency-level  protest  procedures: 

Most  agency  protests  are  filed  pro  se  by  a  vendor  who  thinks  a  mistake  has  been  made  but  doesn't  want 
to  involve  itself  in  a  more  formal  process.  Though  many  agency  protests  contain  intemperate  language, 
protestors  to  the  agency  generally  see  themselves  as  in  a  less  adverse  position  to  the  agency  than  those 
who  go  to  GAO  orthe  Court  of  Federal  Claims. 

Distrust  that  Agency  will  reverse  itself  prevents  some  contractors  from  using  agency  procedures. 

Lack  of  confidence  on  the  part  of  industry  that  the  agency  will  provide  (be  able  to  provide)  appropriate 
relief. 

We  encourage  agency  protests.  We  would  preferto  educate  disappointed  offerors  through  this  process 

rather  than  GAO. 

Contractors  are  reluctant  to  issue  agency  level  protests  fearing  the  agency  doesn't  fairly  consider  their 
protest. 

likelihood  of  greater  payout/success  and  greater  familiarity  with  GAO 

Figure  29.  Respondent  Comments  on  Factors  that  Motivate  or  Constrain  a  Protestor  to 

Utilize  Agency  Protest  Procedures 


These  comments  are  consistent  with  other  academic  studies  which  note  “contractors  and 
attorneys  have  voiced  doubts  about  the  general  ability  of  procuring  agency  personnel  to 
render  fair  and  impartial  protest  decisions. 

In  terms  of  policy,  the  lack  of  a  financial  disincentive  for  protestors  filing  a 
protest  that  is  ultimately  denied  or  dismissed  was  consistently  noted  by  respondents. 
Figure  30  lists  some  of  the  most  common  comments  regarding  the  lack  of  disincentives 
for  filing  frivolous  or  meritless  protests. 


Erik  A.  Troff,  “The  United  States  Agency-Level  Bid  Protest  Mechanism:  A  Model  for  Bid 
Challenge  Procedures  in  Developing  Nations,”  15  Air  Force  Law  Review  (2005):  148. 
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Lack  of  Disincetives  for  Protestors 

Loser  pays  litigation  costs  to  winner.  If  Gov  wins,  loser  pays  reasonable  FTE  salaries  of  CO,  legal  advisor, 
technical  evaluator  etc.  expended  in  processing  the  protest. 

Loser  pays.  Industry  must  be  held  accountable  forfrivolous  protests  that  delay  procurements  when  they 
have  no  chance  of  winning. 

There  should  be  some  potential  penalty  for  the  filing  of  a  clearly  frivolous  or  groundless  protest... 

There  should  be  some  penalties  for  wasting  everyone's  time  and  effort  defending  frivolous  lawsuits  or 
lawsuits  with  little  or  no  merit,  especially  considering  most  protests  are  denied.  Also,  maybe  more  training 
and  publicizing  of  alternative  means  of  resolving  disputes  between  contractors  and  the  Government.  There 
should  be  a  "quick  look"  on  a  protest  to  determine  if  it  has  any  merit  before  expending  the  resources 
needed  for  a  full  review.  Keep  metrics  on  "repeat  offenders"  and  those  that  have  a  bad  track  record  of  filing 
frivolous  protests  orthose  without  merit  should  be  penalized. 

Drop  the  "government  pays"  aspect  of  sustainment.  Alternately,  make  contractors  pay  for  government  costs 
if  the  protest  is  dismissed  or  denied. 

There  is  no  penalty  for  filing  a  frivolous  protest,  and  usually  causes  a  tremendous  burden  on  gov 

manpower. 

Very  easy  to  file  protest.  Contractor  has  nothing  to  lose  by  filing  protest. 

Figure  30.  Respondent  Comments  on  the  Laek  of  Disincentives  to  Protest 
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V.  ANALYSIS  OF  FEDERAL  AVIATION  ADMINISTRATION 
AND  ARMY  MATERIAL  COMMAND  AGENCY  PRACTICES 


A,  INTRODUCTION  TO  THE  FAA’S  ODRA  PROCESS 

In  an  effort  to  transform  the  National  Airspace  System,  Congress  specifically 
exempted  the  FAA  from  all  procurement  laws  and  acquisition  regulations  when  it  passed 
the  1996  Department  of  Transportation  Authorization  Act .39  Congress  mandated  that  the 
FAA  develop  a  new  and  distinct  acquisition  system.  Utilizing  advice  and  opinions  from 
public  and  private  sector  experts,  the  FAA  created  the  Acquisition  Management  System 
(AMS).  AMS  became  the  system  used  by  the  FAA  to  procure  the  material,  resources, 
and  services  it  would  need  to  carry  out  its  mission. 

With  the  implementation  of  AMS,  it  became  clear  that  the  FAA  and  its 
contracting  partners  would  no  longer  have  access  to  the  GAO  as  a  forum  to  resolve  bid 
protests.  As  a  result,  in  1997  the  FAA  created  a  new  office,  known  as  the  Office  of 
Dispute  Resolution  for  Acquisition  (ODRA).  The  ODRA  is  the  statutorily  designated 
forum  for  all  contract  disputes  and  bid  protests  arising  under  the  FAA’s  AMS.^o  At  the 
core  of  the  ODRA  dispute  resolution  process  is  a  belief  that  it  is  in  the  interests  of  both 
the  FAA  and  its  private  sector  partners  to  work  together  to  voluntarily  resolve 
procurement  related  disagreements  in  a  timely  and  equitable  manner. 

Congress  directed  the  Administrator  of  the  FAA  to  ensure  that  at  a  minimum,  the 
AMS  resolved  “bid  protests  and  contract  disputes  related  thereto,  using  consensual 
alternative  dispute  resolution  techniques  to  the  maximum  extent  practicable. ”^1  Under 
this  system,  formal  litigation  should  only  be  employed  as  a  last  resort  to  resolve  a  bid 
protest.  As  noted  in  the  Vision  100-Century  of  Aviation  Reauthorization  Act  of  2003, 

The  resolution  of  bid  protest  and  contract  disputes  related  thereto,  using 
consensual  alternative  dispute  resolution  techniques  to  the  maximum 
extent  practicable... a  bid  protest  or  contract  dispute  that  is  not  addressed 

39  United  States  Code,  49  §  401 10(d)2. 

40  United  States  Code,  49  §  401 10(d)3. 

41  United  States  Code,  49  §  40110(d)l(B). 
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or  resolved  through  alternative  dispute  resolution  shall  be  adjudieated  by 
the  Administrator  through  Dispute  Resolution  Offieers  or  Speeial  Masters 
of  the  FAA  ODRA .42 

ADR  produees  a  faster  and  less  eostly  outeome  when  eompared  to  htigation.43 
The  FAA  has  sueeessfully  used  ADR  to  resolve  most  of  the  protests  brought  before  the 
ODRA.  Additionally,  through  ADR,  the  parties  themselves  maintain  eontrol  over  the 
proeess  and  usually  end  up  strueturing  a  settlement  that  produces  a  “win-win”  situation 
for  those  involved.  Unlike  litigation,  ADR  helps  the  parties  involved  preserve  a  mutually 
beneficial  and  amicable  business  relationship  with  one  and  other.  In  the  simplest  of 
terms,  the  ODRA  process  was  designed  with  the  goal  of  providing  a  fair,  fast,  and 
efficient  resolution  to  disputes  and  protests  under  adjudication  standards  outlined  in  the 
Administrative  Procedures  Act.44 

Because  the  ODRA  expects  both  parties  to  attempt  ADR,  most  cases,  almost 
universally  are  resolved  through  ADR.  Further,  the  decision  to  use  ADR  is  not  left  up  to 
the  discretion  of  the  parties  involved,  but  rather  it  is  immediately  discussed  during  the 
initial  status  conference,  which  is  normally  held  within  the  first  five  (5)  business  days 
after  a  protest  filing.45 

B,  KEY  DIFFERENCES  BETWEEN  FAA  AND  GAO’S  BID  PROTEST 
PROCESS 

In  terms  of  volume,  the  caseload  at  GAO  is  significantly  larger  than  at  ODRA.  In 
an  average  year  ODRA  handles  about  fifty-five  (55)  protests,  compared  to  the  more  than 
1,400  protests  filed  at  GAO. 46  The  GAO  however  has  a  larger  staff,  and  has  been  issuing 
decisions  on  bid  protests  since  the  1920s.47  On  average,  the  GAO  issues  a  decision 
between  day  seventy-five  (75)  and  day  one-hundred  (100).  In  certain  circumstances. 


42  Public  Law  108-176,  section  224b(l). 

43  Worthington  and  Goldsman,  Contracting  with  the  Federal  Government,  All. 

44  United  States  Code,  5  §  551-559. 

43  Code  of  Federal  Regulations,  14  §  17.17  (b). 

46  Federal  Procurement  Institute. 

42  Kepplinger,  “Commentary:  GAO's  Bid  Protest  Role,”  2. 
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whether  on  the  request  of  a  party,  or  on  its  own  initiative,  GAO  may  utilize  an  express 
option,  wherein  a  deeision  is  made  within  sixty-five  (65)  days."^^ 

In  comparison,  the  process  at  ODRA  is  normally  concluded  at  the  fifty-two  (52) 
day  mark Since  ODRA  is  part  of  the  FAA,  there  is  greater  cooperative  interaction 
between  ODRA  officers,  FAA  program  offices,  and  contractors  in  pursuing  mutually 
agreeable  ADR  efforts  at  early  stages  of  the  acquisition  process,  often  times  prior  to  the 
filing  of  a  formal  protest  with  ODRA.  Comparatively,  the  GAO,  as  an  agency  in  the 
Legislative  Branch,  rarely  makes  recommendations  or  influences  agency  action  prior  to 
receipt  of  a  protest  by  an  aggrieved  party. 

A  key  difference  between  ODRA  and  GAO  is  that  ODRA  uses  ADR  as  the 
primary  method  of  protest  resolution,  whereas  the  GAO  tends  to  promote  ADR  only  if 
the  parties  concerned  are  willing.  Within  the  ODRA,  there  is  a  presumption  that  parties 
will  utilize  ADR.  In  fact,  within  five  (5)  days  of  the  initial  status  conference,  parties 
must  elect  to  use  ADR  or  submit  “joint  or  separate  explanations  as  to  why  ADR 
proceedings  will  not  be  used  and  the  Default  Adjudicative  Process  will  be  needed.’’^^  In 
addition,  even  if  the  parties  are  unable  to  utilize  ADR,  the  FAA  may  nonetheless  utilize 
“informal  ADR  techniques... concurrently  with  and  in  parallel  to  adjudication. 
However,  the  greatest  distinction  between  the  two  protest  forums  is  in  the  character  of  the 
forum  itself.  The  GAO  process  is  extremely  formal  and  adversarial  in  nature.  Agency 
reports  must  be  produced  and  defended  by  the  agency,  and  the  aggrieved  offeror  has  the 
ability  to  offer  comments  on  the  agency  report. 

In  comparing  the  notional  timeframes  of  a  bid  protest  under  the  GAO  system  and 
the  FAA  system,  one  can  clearly  see  the  benefits  of  the  FAA  system.  As  shown  in  Figure 
3 1 ,  the  FAA  system,  with  its  emphasis  on  ADR  usually  results  in  an  earlier  resolution  of 
protest  than  compared  to  GAO  procedures. 

4^  Code  of  Federal  Regulations  4  §  21.10 

49  Riehard  D.  Lieberman  and  Jason  D.  Morgan,  The  100  Worst  Mistakes  in  Government  Contracting 
(Ashbum:  National  Contraet  Management  Assoeiation,  2008),  29. 

Code  of  Federal  Regulations,  14  §  17.17  (b)l(e). 

Code  of  Federal  Regulations,  14  §  17.31  (e). 
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Key  Protest  Milestones 

Time  t'lmits  coicukited  in  business  days. 
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Figure  3 1 .  Comparison  of  GAO^^  ys.  FAA^s  Timeline  of  Key  Protest  Milestones. 

C.  THE  U.S.  ARMY  MATERIEL  COMMAND’S  AGENCY  LEVEL 
PROTEST  PROGRAM. 

Under  the  authority  of  FAR  part  33.103(c),  AMC  attempts  to  use  a  progressive 
approach,  coupled  with  creative  initiatives  in  an  effort  to  meet  its  litigation  challenges. 
The  objectives  of  the  AMC  ADR  program  are  to  utilize  an  interdisciplinary  approach  to 
address  conflict  resolution  and  to  design  processes  that  enable  the  parties  to  foster 
creative,  acceptable  solutions.  The  result  are  expeditious  decisions  that  require  fewer 
resources  than  formal  litigation.^^ 

The  primary  steps  in  AMC’s  ADR  process  include  negotiation,  mediation,  fact¬ 
finding,  arbitration,  and  mini-trial.  Commonly  used  definitions  of  these  terms  and  other 
ADR  terms  applicable  to  procurement  related  ADR  are  contained  in  Appendix  A.  In 
1991,  this  process  was  developed  and  within  four  years  the  AMC-Level  Protest  Program 

Code  of  Federal  Regulations  4  §  21.0,  et  seq. 

Code  of  Federal  Regulations  14  §  17.0,  et  seq. 

Alternative  Dispute  Resolution  Program,  passim. 
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was  designated  as  one  of  the  “Ten  Best  Government  Proeurement  Practiees”  by  the 
Offiee  of  Federal  Proeurement  Policy.  The  1995,  Executive  Order  12979  directing 
federal  agencies  to  allow  protests  to  be  fded  at  an  agency  level  above  the  CO  was  a 
process  modeled  after  the  AMC-Level  Protest  Program.55 

Some  of  the  remedies  offered  by  AMC’s  Level  Protest  Program  include  the 
following: 

•  Contract  termination 

•  Recompetition  of  requirement 

•  Solicitation  revision 

•  Direction  to  not  exercise  an  option 

•  Contract  award 

•  A  combination  of  the  above 

Using  these  remedies,  AMC  has  resolved  hundreds  of  protests  in-house,  avoiding  the  cost 
of  litigation  associated  with  a  protest  at  GAO.  In  order  to  reduce  the  number  of  protests, 
AMC  places  a  strong  emphasis  on  conducting  meaningful  debriefings.  This  strategy 
supports  the  agency’s  ADR  initiative.  AMC  encourages  its  activities  and  contractors  to 
“partner.”  This  is  a  philosophy  and  process  that  emphasizes  open  communication  and 
early  identification  of  potential  problems.  The  partnering  parties  work  together  to 
develop  a  charter  that  identifies  common  goals  and  objectives  that  the  parties  are 
committed  to  achieving  together.  The  non-adversarial  nature  of  this  technique  seems  to 
have  improved  the  nature  of  the  relationship  between  AMC  and  its  contractors. 

Consistent  with  President  Clinton’s  Executive  Order,  which  still  remains  in  effect, 
AMC  has  developed  an  iterative  strategic  planning  process  to  better  coordinate  ADR 
programs.  The  goal  of  this  effort  is  to  better  leverage  ADR  resources  and  to  create 
greater  knowledge  about  ADR  processes  throughout  the  Army. 

AMC  is  working  to  expand  ADR  training  opportunities  for  lawyers  and  non¬ 
lawyers  alike.  In  an  effort  to  identify  conflicts  likely  to  benefit  from  ADR,  but  for  which 
there  exists  no  well  established  ADR  program,  AMC  has  increased  its  focus  on 

U.S.  Army  Materiel  Command,  5. 


59 


information  collection  from  the  field.  AMC’s  Office  of  Command  Counsel  is  pooling 
the  resources  and  knowledge  available  at  field  installations,  with  an  eye  towards 
expanding  the  use  of  ADR  in  areas,  such  as  Equal  Employment  Opportunity,  labor- 
management  relations,  and  environmental  stewardship.^^ 

D,  KEY  DIFFERENCES  BETWEEN  AMC  AND  GAO’S  BID  PROTEST 
PROCESS 

Eike  the  EAA,  the  number  of  protests  filed  with  AMC  is  significantly 
smaller  than  the  number  of  protests  filed  with  GAO.  AMC  handles  about  seventy-five 
(75)  protests  per  year  compared  to  the  over  1,400  protests  filed  with  GAO  in  a  given 
year.  Average  decision  times  however  are  shorter  at  AMC.  AMC  is  able  to  issue  its 
decisions  within  fifteen  (15)  days,  far  in  advance  of  the  thirty-five  (35)  day  requirement 
of  Ear  Part  33.^7  Comparatively,  under  the  express  option  decisions  at  GAO  are  issued 
within  sixty-five  (65)  days  at  GAO  or  between  seventy-five  (75)  and  one-hundred  (100) 
days  under  GAO’s  normal  adjudicative  process.  Eigure  32  compares  the  AMC’s  protest 
timeline  to  that  of  the  GAO. 


56  Recent  Army  ADR  Achievements,  1 . 

5^  Federal  Acquisition  Regulations  Part  33(103(c). 
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Key  Protest  Milestones 

Ttme  limits  cakxikned  in  business  days. 
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Figure  32.  Comparison  of  GAO^^  vs.  AMC^^  Timeline  of  Key  Protest  Milestones 
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VI.  SUMMARY  AND  ANALYSIS 


Clearly,  best  practiees  exist  within  the  federal  government.  The  FAA  and  AMC 
programs  represent  two  leading  edge  programs,  designed  from  the  outset  to  create  a 
harmonious  business  relationship  between  government  and  private  industry.  The 
professional  men  and  women  who  staff  the  acquisition  and  legal  offices  in  the  federal 
government  are  another  clear  source  of  best  practices.  Their  tremendous  professional 
knowledge,  significant  expertise,  and  practical  experience  were  the  basis  for  our  research 
survey. 

Acquisition  managers  are  no  doubt  interested  in  reducing  program  costs  and  time 
delays.  Some  of  the  more  effective  ways  to  do  so  are  to  employ  ADR  processes  to  the 
maximum  extent  practicable,  seek  overrides  of  mandatory  stays  when  in  the  best  interests 
of  the  government,  to  take  voluntary  corrective  action  when  appropriate,  and  to  raise 
objections  to  protests  that  are  frivolous  or  otherwise  lack  merit.  From  our  research,  it 
seems  that  in  many  instances  such  practices  are  often  under-utilized  or  not  employed  at 
all.  We  are  left  with  a  number  of  answers  to  the  research  questions  considered  at  the 
beginning  of  this  project. 

A,  ANSWERS  TO  RESEARCH  QUESTIONS 

1,  Strategies  and  Practices  Employed 

•  What  strategies  or  practices  are  currently  being  used  to  minimize  the 
impact  of  bid  protests  on  the  acquisition  process  while  maintaining 
integrity,  economy,  and  efficiency? 

Our  research  has  shown  that  there  are  numerous  strategies  and  practices  currently 
being  used  to  minimize  the  impact  of  bid  protests  on  the  acquisition  process,  while 
maintaining  the  ideals  of  integrity,  economy,  and  efficiency.  From  review  of  procedures 
at  the  FAA  and  AMC,  we  see  that  ADR  is  being  utilized  as  an  effective  tool  to  minimize 
the  impact  of  protests.  What  characterizes  the  ADR  programs  of  both  FAA  and  AMC  as 
so  successful  is  the  presumption  that  all  protest  will  be  resolved  through  ADR,  unless 
there  are  countervailing  reasons  to  the  contrary. 
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From  our  survey  of  acquisition  and  legal  professionals,  a  number  of  these 
practices  have  been  identified: 

•  Setting  in  advance  clear  and  publicly  disclosed  evaluation  criteria  and 
adhering  to  these  criteria  during  source  selection. 

•  Advanced  acquisition  planning. 

•  Agency  procedures  to  prevent  fraud,  procurement  integrity  violations, 
and/or  organizational  conflicts  of  interests. 

•  Providing  quality  mandatory  debriefings. 

•  Thorough  market  research  and  engagement  with  industry. 

•  Agency  level  protest  procedures. 

Some  of  the  comments  we  received  from  survey  respondents  also  demonstrate 
that  institutional  peer  reviews  are  practiced  by  many  federal  agencies.  Peer  reviews  may 
go  beyond  just  merely  reviewing  a  CO’s  technical  documentation.  Peer  reviews  can 
encompass  a  review  of  overall  acquisition  strategies. 

2.  Barriers  to  Effective  Resolution 

•  What  current  processes  or  regulations  preclude  effective  avoidance  or 
resolution  of  bid  protests  in  a  manner  that  minimizes  adverse  impact  on 
the  acquisition  system? 

Our  survey  identified  a  number  of  process  and  regulations  that  preclude  effective 
resolution  or  avoidance  of  bid  protests.  Some  of  the  most  common  processes, 
regulations,  and  policies  include: 

•  The  lack  of  fiscal  disincentives  for  unjustified  protests  such  as  “loser 
pays”  arrangements. 

•  Poor  acquisition  planning. 

•  Lack  of  properly  trained  acquisition  workforce. 

•  Frivolous  protest  filings. 

•  Lack  of  formal  sanctions  at  the  GAO  for  frivolous  protests. 

3.  Obstacles  to  Effective  Cooperation 

•  What  are  the  obstacles  that  impede  effective  cooperation  in  resolving  bid 
protest? 
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Most  legal  and  acquisition  professionals  surveyed  indicate  that  they  believe  that 
their  agencies  do  not  use  ADR  to  a  great  extent  to  resolve  protests.  However,  the 
research  we  conducted  regarding  the  FAA  and  AMC,  show  the  clear  benefit  of  utilizing 
ADR.  At  both  the  FAA  and  AMC  bid  protests  are  resolved  earlier  than  they  are  at  GAO. 
It  appears  that  for  most  agencies,  a  reluctance  to  utilize  ADR  as  a  means  to  resolve 
protests  is  an  obstacle  that  impedes  effective  cooperation. 

Our  research  survey  also  indicates  that  there  may  be  other  reasons,  beyond  agency 
cooperation,  that  create  obstacles  to  more  effective  cooperation  between  industry  and 
government.  Numerous  survey  respondents  cited  the  fact  that  they  believe  agency  level 
protest  procedures  could  be  more  effective,  if  unsuccessful  offerors  had  greater  trust  in 
the  agency.  In  this  regard,  trust  seems  to  be  a  major  obstacle  in  more  effective 
cooperation.  If  protestors  do  not  trust  agencies  to  take  remedial  action  when  appropriate, 
then  effective  cooperation  between  the  two  parties  is  impaired. 
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VII.  RECOMMENDATIONS  AND  AREAS  FOR  FURTHER 

RESEARCH 


A,  RECOMMENDATIONS 

1.  Case  for  Fiscal  Disincentives  beyond  Truly  Frivolous  is  not 
Demonstrated 

Our  research  has  revealed  that  agency  personnel  have  strong  opinions  regarding 
the  need  for  some  type  of  disincentives  for  unsuccessful  protestors.  The  opinions  range 
from  “loser  pays”  scenarios,  where  the  losing  party  to  the  protest  must  reimburse  the 
other  for  the  cost  of  the  unsuccessful  litigation,  to  more  reserved  opinions,  where 
penalties  are  only  assessed  for  those  protests  that  are  deemed  to  be  truly  frivolous. 

There  is  no  doubt  that  the  lack  of  disincentives  for  filing  an  unsuccessful  protest 
may  contribute  to  the  litigious  desires  of  a  would-be  protestor.  Nonetheless,  we  are  not 
convinced  that  such  disincentives  are  prudent.  While  such  a  procedure  may  very  well 
reduce  the  negative  impact  frivolous  protests  have  on  the  acquisition  system,  it  may  do  so 
at  the  expense  of  legitimate  protests.  Such  disincentives  may  actually  discourage 
participation  in  the  federal  contracting  process  and  as  a  result  competition  may 
decrease.^*’  Further,  in  order  to  determine  whether  or  not  a  protest  is  indeed  frivolous,  it 
would  require  additional  action  on  the  part  of  the  GAO.  Currently,  GAO  determines 
initially  whether  or  not  a  protest  meets  the  requirements  for  filing  a  protest  (timely,  an 
interested  party,  etc. . .)  and  subsequently  determines  the  merit  of  the  protest.  In  order  to 
determine  that  a  protest  is  sanctionable  as  frivolous,  GAO  would  have  to  make  a  separate 
determination.  Under  Rule  1 1  of  the  Rules  of  the  Court  of  Federal  Claims,  a  protester  can 
be  sanctioned  only  if  the  protest: 

(1)  is  being  presented  for  any  improper  purpose,  such  as  to  harass,  cause 
unnecessary  delay,  or  needlessly  increase  the  cost  of  litigation; 
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(2)  the  claims,  defenses,  and  other  legal  contentions  are  warranted  by  existing  law 
or  by  a  nonfrivolous  argument  for  extending,  modifying,  or  reversing  existing  law  or  for 
establishing  new  law; 

(3)  the  factual  contentions  have  evidentiary  support  or,  if  specifically  so 
identified,  will  likely  have  evidentiary  support  after  a  reasonable  opportunity  for  further 
investigation  or  discovery;  and 

(4)  the  denials  of  factual  contentions  are  warranted  on  the  evidence  or,  if 
specifically  so  identified,  are  reasonably  based  on  belief  or  a  lack  of  information. 

Necessarily,  a  protestor  would  have  some  right  to  due  process  in  order  to  “avoid 
punishing  a  company  for  filing  a  good-faith  but  unmeritorious  protest.”^!  This  process 
may  actually  make  the  overall  protest  process  longer,  which  could  have  potential 
negative  impacts  on  the  acquisition  system. 

2.  Agencies  must  Vigorously  Object  to  Protests  when  Appropriate 

Related  to  the  matter  of  frivolous  protests  are  agency  actions  designed  to  properly 
document  their  objections  to  a  protest.  The  GAO  “dismisses  protests,  where  appropriate, 
without  the  need  to  resolve  whether  the  protest  was  frivolous. jt  is  incumbent  on 
agencies  however,  to  object  to  protests  when  appropriate.  Our  research  revealed  that 
many  acquisition  and  legal  professionals  believe  frivolous  protests  frequently  preclude 
effective  resolution  of  bid  protests.  Yet  the  very  same  individuals  indicated  that  they 
believe  their  agencies  infrequently  raise  vigorous  objections  in  response  to  frivolous 
protests.  Since  the  GAO  will  dismiss  protests  that  are  without  merit,  it  is  incumbent 
upon  agency  officials  to  raise  objections  to  protests  they  deem  to  be  frivolous  or 
otherwise  without  merit. 

3,  Provide  Quality  Debriefs  to  Preveut  or  Limit  Strategic  Protests 

Numerous  survey  respondents  provided  comments  regarding  the  strategic  reasons 
that  may  induce  an  unsuccessful  offeror  to  file  a  protest.  One  respondent  called  such 
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protests  “fishing  expeditions”  while  another  stated  it  was  a  means  to  “eircumvent  FOIA.” 
Respondents’  rationale  is  that  by  filing  a  protest,  even  if  ultimately  unsuccessful,  the 
protestor  may  obtain  some  information  that  he  can  later  use  to  his  advantage.  One  means 
by  which  agencies  can  prevent  such  behavior  is  to  provide  a  high  quality  debriefing.  If 
an  unsuccessful  offeror  has  been  thoroughly  debriefed  as  to  why  he  was  not  selected  for 
award,  he  may  not  feel  he  needs  any  additional  information,  and  as  a  result  he  may  be 
less  inclined  to  file  a  protest.  A  thorough  debrief  may  also  convince  an  unsuccessful 
offeror  that  he  was  in  fact  not  prejudiced  by  the  agency’s  decision  and  therefore  has  no 
need  to  file  a  protest. 

Even  with  complete  and  thorough  debriefs;  some  protestors  will  want  to  file  a 
protest  in  order  to  seek  information  not  otherwise  available  to  them.  A  change  in  agency 
policy  could  prevent  this  occurrence.  The  information  asymmetry  that  exists  between 
the  government  and  unsuccessful  offerors  may  very  well  influence  an  offeror’s  decision 
to  protest.  Government  agencies  can  prevent  this  from  occurring  by  eliminating  or 
reducing  the  asymmetry.  Information  that  is  normally  made  available  to  an  unsuccessful 
offeror  only  after  having  filed  a  protest  should  be  made  available  to  the  offeror  absent  a 
formal  protest  filing.  This  may  eliminate  one  incentive  that  an  unsuccessful  offeror  has 
in  filing  a  protest. 

4.  Require  Parties  to  Document  Decision  not  to  use  ADR  and  other 
Similar  Tools 

Our  review  of  ODRA  procedures  highlighted  the  primary  use  of  ADR  to  resolve 
protests.  We  noted  the  fact  that  ODRA  was  able  to  resolve  protests  more  quickly  than 
when  compared  to  the  GAO’s  bid  protest  process.  Within  ODRA,  there  is  an  overriding 
presumption  that  parties  will  resolve  protests  through  ADR.  If  unable  to  utilize  ADR, 
both  parties  must  submit  explanatory  statements  to  the  Dispute  Resolution  Officer.  The 
presumption  that  parties  will  utilize  ADR,  unless  there  is  a  countervailing  reason  to  the 
contrary,  is  a  primary  driver  behind  ODRA’s  processes.  The  GAO  in  its  regulations  and 
the  Executive  Branch  through  the  Eederal  Acquisition  Regulation  should  adopt  a  similar 
procedural  policy,  and  require  each  party  to  conduct  cost-benefit  analysis  and 
affirmatively  demonstrate  why  ADR  cannot  be  utilized  to  resolve  the  protest.  Such  a 
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policy  would  likely  reduce  the  time  delays  and  eosts  an  ageney  must  endure  during  a  bid 
protest.  Ageneies  ean  also  be  required  to  formally  demonstrate  why  it  does  not  seek 
dismissal,  early  eorrective  aetion,  or  stay  overrides. 

B,  AREAS  FOR  FURTHER  RESEARCH 

Our  research  has  revealed  a  number  of  further  areas  of  study  that  warrant 
additional  researeh.  Speeific  areas  of  study  inelude: 

•  Analyze  and  doeument  eontraetor  motivation  to  file  a  protest.  Such 
research  should  include  a  thorough  understanding  of  the  business 
deeisions  that  either  eonstrain  or  enhanee  a  eontraetor’ s  motivation  to  file 
a  protest. 

•  Conduet  further  analysis  into  debriefing  proeedures.  Best  praetiees  for 
eondueting  a  suceessful  debriefing  need  to  be  researehed  and  doeumented. 

•  Researeh  into  areas  of  strategy  and  praetiees  that  survey  respondents  cited 
with  minimal  frequeney.  A  number  of  these  strategies  and  praetiees 
appear  useful  in  mitigating  the  negative  effeet  of  redueing  the  impact  of 
bid  protests,  yet  they  are  underreported  in  our  researeh.  Further  study 
into  this  area  should  be  eondueted. 

•  Aequisition  planning  is  cited  the  most  commonly  cited  strategy  or  practiee 
to  minimize  the  impact  of  bid  protests  on  the  aequisition  proeess.  Best 
praetiees  for  all  faeets  of  aequisition  planning  should  be  researehed  and 
doeumented. 

•  The  laek  of  finaneial  disineentives  for  unsueeessful  offerors  was  a  highly 
eited  policy  that  precludes  the  effeetive  resolution  or  avoidance  of  bid 
protests.  Although  we  have  previously  stated  our  reeommendation  on  this 
poliey,  we  nonetheless  feel  that  further  researeh  is  warranted. 
Speeifieally,  researeh  must  be  eondueted  into  the  negative  externalities 
that  may  be  assoeiated  with  financial  disincentives. 
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APPENDIX  A.  ADR  DEFINITIONS 


U.S.  DEPARTMENT  OF  JUSTICE  ELECTRONIC  GUIDE  TO  FEDERAL  PROCUREMENT  ADR 


ADR  Definitions 


The  following  are  some  commonly  used  definitions  of  ADR  terms  applicable  to 
procurement-related  ADR.  Agencies  may  differ  in  the  manner  in  which  they  define  such 
terms.  Also,  some  of  these  terms  may  be  used  differently  in  other  contexts. 

Arbitration  -  A  dispute  resolution  process  whereby  a  neutral  third-party  is  empowered 
by  agreement  of  the  parties  to  issue  a  decision  on  the  controversy,  following  the  conduct 
of  a  trial-like  hearing.  An  arbitrator's  decision  is  generally  binding  and  not  reversible, 
absent  fraud  or  misconduct  on  the  part  of  the  arbitrator.  Arbitrators  often  are  asked  to 
attempt  to  mediate  (see  below)  a  settlement  first,  and  to  impose  a  decision  on  the  parties 
only  as  a  last  resort.  This  hybrid  process  is  frequently  referred  to  as  "Med/Arb". 

Conciliation  -  Efforts  by  a  neutral  third  party  to  assist  in  the  resolution  of  an  issue  in 
controversy,  including  holding  meetings  with  individual  parties  to  discuss  the 
controversy  and  potential  solutions;  contacting  individual  parties  by  telephone  or  mail, 
and  serving  as  a  conduit  for  information  between  them. 

Early  Neutral  Evaluation  -  The  process  by  which  an  neutral  third  party  imparts  to  the 
parties  his/her  views  as  to  the  strengths  and  weaknesses  of  their  respective  positions 
relating  to  an  issue  in  controversy.  This  process  frequently  is  combined  with  conciliation 
or  mediation. 

Fact  Finding  -  A  process  in  which  a  neutral  third  party  assists  the  parties  to  determine  in 
an  objective  manner  the  facts  relating  to  an  issue  in  controversy.  Frequently,  fact  finding 
will  be  engaged  in  as  a  prelude  to  mediation. 

Mediation  -  An  effort  by  a  neutral  third  party  to  resolve  an  issue  in  controversy  through 
the  conduct  of  face-to-face  meetings  between  the  disputing  parties.  The  third  party  is  not 
authorized  to  impose  a  settlement  upon  the  parties,  but  rather  seeks  to  assist  the  parties  in 
fashioning  a  mutually  satisfactory  solution  to  the  issue  in  controversy.  Mediation  can 
take  two  forms;  (1)  facilitative  mediation  —  in  which  the  mediator  simply  facilitates 
discussions  between  or  among  the  parties  and  does  not  provide  any  form  of  evaluation  of 
the  merits  of  their  respective  positions;  and  (2)  evaluative  mediation  —  in  which  the 
mediator  provides  the  parties,  either  individually  or  jointly,  with  early  neutral 
evaluation  (see  above),  i.e.,  his/her  views  as  to  the  strengths  and  weaknesses  of  their 
respective  positions,  in  conjunction  with  the  mediator's  efforts  to  help  the  parties  fashion 
an  amicable  resolution  to  their  controversy. 
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Mini-Trial  -  A  procedure  where  the  parties  make  abbreviated  presentations  to  a  neutral 
third  party  who  sits  with  the  parties'  designated  prineipal  representatives  as  a  mini-trial 
panel  to  hear  and  evaluate  evidenee  relating  to  an  issue  in  eontroversy.  The  neutral  may 
thereafter  meet  with  the  prineipal  representatives  to  attempt  to  mediate  a  settlement.  The 
mini-trial  proeess  may  also  be  a  prelude  to  the  neutral's  issuanee  of  either  a  formal 
written  non-binding  advisory  opinion  or  to  the  neutral's  rendering  of  a  binding  arbitration 
award. 

Ombuds  -  An  individual  who  has  been  designated  as  a  eonfidential  and  informal 
information  resouree,  eommunieations  ehannel,  eomplaint-handler  and  dispute-resolver. 
The  ombuds  role  was  intended  to  be  an  antidote  to  abuses  of  governmental  and 
bureaueratie  authority  and  administration,  and  ombuds  may  serve  as  effeetive  intervenors 
in  eases  of  arbitrary  deeision  making. 

Summary  Trial  With  Binding  Decision  -  A  binding  ADR  proeedure  utilized  by  Boards 
of  Contraet  Appeals  wherein  the  parties  make  abbreviated  evidentiary  presentations 
eoneerning  an  issue  in  eontroversy,  and  the  Board  judge  renders  a  summary  binding  and 
non-appealable  deeision.  The  deeision,  frequently  rendered  from  the  beneh,  may  not  be 
used  as  preeedent  in  the  future. 
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APPENDIX  B.  RESEARCH  SURVEY 


Achieving  Better  Acquisition  Outcomes  in  Bid  Protests:  ADR  and 

1.  Consent  to  particpate  in  research 


Naval  Postgraduate  School 
Consent  to  Participate  in  Research 

Introduction.  You  are  invited  to  participate  in  a  research  study  entitled  'Achieving  Better  Acquisition 
Outcomes  in  Bid  Protests:  ADR  and  Other  Best  Practins  for  Prevention  and  Resolution.”  The  Naval 
Postgraduate  School  (NPS)  is  conducting  a  study  on  behalf  of  the  Office  of  Assistant  Secretary  of  the 
Air  Force  for  Acquisition  concemir>g  the  bid  protest  process.  Among  other  thir>gs,  our  study  examines 
possible  ways  to  minimize  r>egabve  time  and  cost  impacts  of  bid  protests,  to  reduce  frivolous  or  meritless 
protests,  and  to  assess  the  efficacy  of  Altemabve  Dispute  Resolution  (ADR)  in  bid  protests. 

Procedures.  An  agency  point  of  contact  within  legal  and/or  acquisition  leadership  office  is  contracted  by 
e-mail  with  request  to  participate  in  an  anonynrwus  survey.  The  survey  will  be  conducted  electronically 
using  Surveynrionkey.com.  Estimated  length  of  each  subject's  participation:  up  to  1  hour  responding  to 
survey.  Secondary  data  will  be  collected  to  the  extent  it  was  already  made  public,  or  to  the  extent 
partidpatir>g  agency  leaders/experts  find  it  appropriate.  Examples  data  include  public  data  on  bid 
protests  available  on  the  Government  Accountability  Office  website,  or  data  on  use  of  ADR  in  bid 
protests  from  agency  records. 

Voluntary  Nature  of  the  Study.  Your  participation  in  this  study  is  strictly  voluntary.  If  you  choose  to 
participate  you  can  change  your  mind  at  any  time  and  withdraw  from  the  study.  You  will  rxrt  be 
penalized  in  any  way  or  lose  any  benefits  to  which  you  would  otherwise  be  entitled  if  you  choose  not  to 
participate  in  this  study  or  to  withdraw. 

Potential  Risks  and  Discomforts.  This  study  does  not  request  official  agency  positions  on  laws, 
regulations,  or  specific  cases,  and  does  not  seek  information  that  may  be  subject  to  protective  orders  In 
procurement  protests.  Participants  adhering  to  these  limitations  should  not  be  subject  to  any  risks  or 
discomforts.  Risks  for  participants  breaching  these  limftations  may  indude  embarrassment  or  penalties  as 
may  be  imposed  by  law. 

Anticipated  Benefits.  Antidpated  benefits  from  this  study  indude  improvements  to  the  procurement 
protest  process  throughout  the  Department  of  Defense  and  at  other  Executive  Branch  agencies.  Study 
results  are  expected  to  reduce  program  disruptions  and  costs  from  protests  to  Federal  acquisition 
programs. 

Compensation  for  Participation.  No  tangible  compensation  will  be  given.  Rnal  research  report  will  be 
available  to  your  agency  at  the  condusion  of  the  study. 

Confidentiality  &  Privacy  Act.  Any  infoimation  that  is  obtained  during  this  study  will  be  kept  cor^idential 
to  the  full  extent  permitted  by  law.  No  personally  identifying  information  will  be  collected  as  part  of  the 
survey.  Further,  all  reasonable  efforts  will  be  made  to  keep  personal  information  for  agency  points  of 
contract  confidential.  No  names  or  tiJes  will  be  published  in  the  study  report.  Records  will  be  stored  in 
the  paper  and  electronic  files  of  the  research  team  and  on  related  electronic  accounts  in  the  NPS 
networks.  However,  it  is  possible  that  the  researcher  may  be  required  to  divulge  information  obtained  in 
the  course  of  this  research  to  the  subject's  chain  of  command  or  other  legal  body.  Therefore,  total 
confidentiality  cannot  be  guaranteed. 

Points  of  Contact.  If  you  have  any  questions  or  comments  about  the  research,  or  you  experience  an 
injury  or  have  questions  about  any  discomforts  that  you  experience  %vhile  takir>g  part  in  this  study  please 
contact  the  Principal  Investigator,  Dr.  Max  Kidalov,  831-656-3254,  mkidalov9nps.navy.mit.  Questions 
about  your  rights  as  a  research  subject  or  any  other  concerns  may  be  addressed  to  the  Navy 
Postgr^uate  School  IRB  Chair,  Dr.  Angela  OT>ea,  831-656-3966,  alodea9nps.edu. 
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^  1.  statement  of  Consent.  I  have  read  the  information  provided  above.  I 
have  been  given  the  opportunity  to  ask  questions  and  all  the  questions  have 
been  answered  to  my  satisfaction.  I  have  been  provided  a  copy  of  this  form 
for  my  records  and  I  agree  to  participate  in  this  study.  I  understand  that  by 
agreeing  to  participate  in  this  research  and  signing  this  form,  I  do  not  waive 
any  of  my  legal  rights. 

C  1  agree 
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*  2.  Please  select  your  agency: 

Agency 

My  agency: 

1  1 

Other  (please  speafy) 

*  3.  Please  choose  your  office: 

AcQuisiton 

Select  One 

O 

Legal 

o 
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(18)  Alternative  dispiite  resolution  (AOR) 
procedures  wrthout  assistance  from  the  GAO 
or  the  Court  of  Federal  Claims 

(19)  taking  earty  corrective  actions 

(20)  Awarding  extensions  or  bridge  contracts 
to  Incumbents  protesting  re-competitlons 

(21)  Seeking  overrides  of  mandatory  stays 
based  on  best  interest  of  the  United  States 

(22)  Seeking  overrides  of  mandatory  stays 
based  on  urgent  and  compelling 
drojm  stances 

(23)  Taking  corrective  actions  involving 
Inclusion  of  protesters  as  subcontractors  or 
mambers  of  winning  taams 

(24)  Taking  corrective  actions  involving  direct 
awards  to  protesters,  instead  of  re* 
competitions  or  re>evaluatlons 

(25)  Taking  correctrve  actions  involving 
dedaratory-type  relief,  such  as  changes  In 
agency  procurement  policies 

(26)  Taking  express  option  requests  under 
GAO  procedures 

(27)  Vigorous  objections  and  requests  for 
sanctions  in  response  to  frivolous  protests 

(28)  Refusal  to  follow  GAO  advisory  opinions 
and  recommendations  where  the  GAO 
sustains  a  protest  on  apparently  wrong 
grounds 

(29)  Greater  oversight.  Including  inspections, 
audits,  and  Ovil  or  cnminal  prosecutions 

(30)  Other  strategies  or  practices  (please 
describe  below) 

(b)  Please  feci  free  to  comment  on  and/or  bnefly  explain 
reasons  for  use  or  non-use  of  any  strategies  or  practices 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

your  answers  above,  including 
described  above: 


il 


77 


78 


Achieving  Better  Acquisition  Outcomes  in  Bid  Protests:  ADR  and 


5.  Aspect  of  Processes,  Laws,  or  Regulations 


6.  (a)  In  your  experience,  what  aspects  of  current 
processes,  policies,  practices,  laws,  or  regulations  preclude 
effective  avoidance  or  resolution  of  bid  protest  in  a  manner 
that  minimizes  adverse  impact  on  the  acquisition  system? 


(1)  ftxH’  Acquisition  planning 

(2)  Lack  of  properly  trained  acquisitton 
workforce 

(3)  Poor  debnefinga 

(4>  Failure  to  maintain  adequate 
documentation  of  procurement  decisions 

(5)  Feiiure  to  assure  feir  discussions  with 
offerors 

(6)  Poorty  designed  or  executed  cost 
evaluations 

(7)  Failure  to  assure  adherence  to  stated 
evaluation  crtterta 

(B)  Regulatory  or  statutory  provtsions 
discouraging  AOR 

(9)  Other  deficiencies  in  ADR  practices 

(10)  Lack  or,  or  deficiencies  in,  agency-level 
bid  protest  procedures 

(11)  Lack  of  formal  sanctions  at  GAO  for 
fnvotous  protests 

(12)  Deleysecking  strategies  by  incumbent 
contractors  who  have  no  legitimate  basis  for 
renewed  awards 

(13)  Strategic  behavior  by  disappointed 
offerors  who  have  no  legitimate  basis  for 
award  tn  order  to  recover  bid  and  proposal 
costs 

(14)  Frivolous  protest  filings 

(15)  Lack  of  fiscal  disincentives  for  unjustified 
protests  such  as  ‘loser  pays*  errengements 

(16)  A.gei>cy  culture  that  discourages  ADR  or 
reconsideration  of  award  decisions 

(17)  Agency  reluctance/fellure  to  seek  award 
stay  overrides 

(IB)  Agency  reluctance  to  seek  express  option 
In  protests 

(19)  Agency  reluctance  to  deviate  from  GAO 
recommendations  end  advisory  opinions  that 
agency  perceives  to  be  wrongly  decided 

(20)  Other  aspects  (please  describe  below) 


Always  or 
TO.  , 
Great 

Extent 

To  e  Rarefy  or 

ModerateTo  Some 

Extent  Extent 

Never 

Don't  Know 

or 

Information 

Unavalieble 

O 

o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o  (b)  Ptease  feel  free  to  comment  and/or  briefly  explain  your  answers  above  and  to  identify 
other  specific  processes,  policies,  laws,  or  regulations  that  preclude  effective  avoidance  or 
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6.  Contractor's  Motivation 

Please  briefly  describe  any  factors  that,  in  your  experience, 
decisions  to: 

motivate  or  consti'ain  a  contractors' 

7.  initiate  protests: 

zi 

8.  protest  under  your  agency's  agency-level  protest  procedures: 

z] 

9.  protest  at  the  GAO: 

±i 

zi 

10.  protest  at  the  Court  of  Federal  Claims: 

±i 

zi 
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11.  challenge  agency  overrides  of  automatic  stays  at  the  Court  of  Federal 
Claims: 


12.  resolve  protests  through  alternative  dispute  resolution  (ADR) 
procedures: 
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7.  Areas  for  Improvement 


13.  Based  on  your  experience,  what  improvements  to  policies,  processes, 
practices,  laws,  or  regulations  would  encourage  effective  avoidance  or 
resolution  of  bid  protests  in  ways  that  minimize  any  negative  impact  of 
protests  on  the  acquisition  system  while  maintaining  transparency,  integrity, 
compliance,  economy,  and  efficiency? 


Zi 
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APPENDIX  C.  LIST  OF  FEDERAL  AGENCIES  SOLICITED 


Department  of  Agrieulture 
Department  of  Commeree 
Department  of  Defense  (DLA) 

Department  of  Edueation 

Department  of  Energy 

Department  of  Health  and  Human  Serviees 

Department  of  Homeland  Seeurity  (Coast  Guard) 

Department  of  Housing  and  Urban  Development 

Department  of  Interior 

Department  of  Justiee 

Department  of  Eabor 

Department  of  State 

Department  of  the  Air  Eoree 

Department  of  the  Army 

Department  of  the  Navy  (Navy  and  Marine  Corps) 

Department  of  Transportation 

Department  of  Treasury 

Department  of  Veterans  Affairs 

General  Serviees  Administration 

National  Aeronauties  and  Spaee  Administration 

U.S.  Ageney  for  International  Development 
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